- All playbooks
- Slow tests
- Test supported runtimes concurrently
Test supported runtimes concurrently
Give each target framework its own job that installs only what it needs.
Company examples
How Stripe used this technique
Read what Stripe changed and follow the original sources.
Test supported runtimes concurrently
Stripe .NET replaced one sequential build-and-test job with per-framework matrix jobs and a native Windows .NET Framework lane. Each lane installs the latest SDK plus only its target runtime, and example builds run in their own job.
- Use it when
- A multi-runtime suite runs sequentially or installs every toolchain in every lane.
- Before applying it
- Keep every supported runtime gated, let every diagnostic matrix leg run to completion, and update branch protection for the new job names.
Company Playbooks
- Read Anthropic’s playbookRun only affected tests
- Read DoorDash’s playbookRun build and test in parallel, sharded across CI agents
- Read Linear’s playbookBenchmark the same job on faster hardware
- Read Mastra’s playbookStarSling runners for the slowest test workflow
- Read OpenAI’s playbookRank CI fixes by the minutes they save
- Read Ramp’s playbookMove a CPU-bound test suite to a faster CPU
- Read Shopify’s playbookLet an agent iterate against one CI metric
- Read Spotify’s playbookBuild arm64 on native arm64 runners
- Read Stripe’s playbookRun only the tests a change can reach
- Read Uber’s playbookBuild the merge-queue speculations most likely to be needed