- All playbooks
- Give historical API probes a precise validation contract
Give historical API probes a precise validation contract
When a check only needs to know that old code still compiles, compile it.
Company examples
How OpenAI used this technique
Read what OpenAI changed and follow the original sources.
Give historical API probes a precise validation contract
The Go SDK's breaking-change detector restores deleted tests from a baseline and checks that they still build against the current code. It now runs go test -c with vet off for that check, and current-tree lint stays in the normal CI workflow.
Breaking-change detector compiles; current-tree lint stays in CI Source
- Use it when
- A compatibility check runs a full lint when its contract is whether historical code still compiles.
- Before applying it
- Compile-only checking runs no behavior tests or vet. Use it only for an explicit compile-compatibility contract, with lint and tests still required elsewhere.
Company Playbooks
- Read Anthropic’s playbookRun only affected tests
- Read DoorDash’s playbookRun build and test in parallel, sharded across CI agents
- Read Linear’s playbookBenchmark the same job on faster hardware
- Read Mastra’s playbookStarSling runners for the slowest test workflow
- Read OpenAI’s playbookRank CI fixes by the minutes they save
- Read Ramp’s playbookMove a CPU-bound test suite to a faster CPU
- Read Shopify’s playbookLet an agent iterate against one CI metric
- Read Spotify’s playbookBuild arm64 on native arm64 runners
- Read Stripe’s playbookRun only the tests a change can reach
- Read Uber’s playbookBuild the merge-queue speculations most likely to be needed