- All playbooks
- Rank fixes by the minutes they save
Rank fixes by the minutes they save
Price every CI fix in minutes saved per day before writing any YAML.
Company examples
How OpenAI used this technique
Read what OpenAI changed and follow the original sources.
Rank fixes by the minutes they save
The team asked its agent to read the repository's CI run history, list ideas to relieve CI load, and rank them by estimated CI minutes saved per day. Following up on that ranked list produced about 30 CI optimization PRs.
About 30 CI optimization PRs landed after ranking ideas by CI minutes saved. Source
- Use it when
- You have CI run history and want to choose a first optimization.
- Before applying it
- Estimates depend on the history window and run frequency. Rank total CI minutes separately from time waiting for a merge.
Company Playbooks
- Read Anthropic’s playbookRun only affected tests
- Read DoorDash’s playbookRun build and test in parallel, sharded across CI agents
- Read Linear’s playbookBenchmark the same job on faster hardware
- Read Mastra’s playbookStarSling runners for the slowest test workflow
- Read OpenAI’s playbookRank CI fixes by the minutes they save
- Read Ramp’s playbookMove a CPU-bound test suite to a faster CPU
- Read Shopify’s playbookLet an agent iterate against one CI metric
- Read Spotify’s playbookBuild arm64 on native arm64 runners
- Read Stripe’s playbookRun only the tests a change can reach
- Read Uber’s playbookBuild the merge-queue speculations most likely to be needed