- All playbooks
- Agent PR volume
- Wait until a draft is ready for expensive checks
Wait until a draft is ready for expensive checks
Avoid spending runner time on expensive validation until a draft pull request becomes ready for review.
Compare approaches
How companies used this technique
Read what each company changed and follow the original sources.
Run expensive checks when a draft becomes ready
Checkout Kit skips its change-detection job, and so every platform job behind it, while a pull request is a draft. Adding ready_for_review to the trigger types starts a full run as soon as the draft is marked ready.
Merged 2026-06-16; both lines are on the default branch. Source
- Use it when
- Developers push to draft pull requests many times before asking for review.
- Before applying it
- Without ready_for_review, a draft promoted to ready keeps its skipped result on an untested commit.
Wait until a draft is ready for expensive checks
SubmitQueue added draft guards to every CI job and its required aggregate, then added ready_for_review to the workflow events. Pushes to main and merge-queue runs keep their validation.
Drafts skip the full suite, and it runs when the pull request is marked ready for review. Source
- Use it when
- Drafts receive frequent exploratory commits and your team agrees that expensive checks can wait.
- Before applying it
- Drafts get feedback later, so agree on it as a team policy. Test draft, ready, reopened, main and merge-queue events so every required check still reports.
Company Playbooks
- Read Anthropic’s playbookRun only affected tests
- Read DoorDash’s playbookRun build and test in parallel, sharded across CI agents
- Read Linear’s playbookBenchmark the same job on faster hardware
- Read Mastra’s playbookStarSling runners for the slowest test workflow
- Read OpenAI’s playbookRank CI fixes by the minutes they save
- Read Ramp’s playbookMove a CPU-bound test suite to a faster CPU
- Read Shopify’s playbookLet an agent iterate against one CI metric
- Read Spotify’s playbookBuild arm64 on native arm64 runners
- Read Stripe’s playbookRun only the tests a change can reach
- Read Uber’s playbookBuild the merge-queue speculations most likely to be needed