- All playbooks
- Measure the cost of the release build profile
Measure the cost of the release build profile
Measure what the release build profile costs before keeping it.
Company examples
How OpenAI used this technique
Read what OpenAI changed and follow the original sources.
Measure the cost of the release build profile
Codex switched its release profile from fat LTO to ThinLTO, kept optimization level 3, and removed the workflow overrides. Its clean-build investigation compared build time, binary size and runtime before choosing.
Clean release build: 2073.893s to 1243.172s; binary 196.7 MiB to 211.8 MiB Source
- Use it when
- Compilation or linking dominates the critical path of a build job.
- Before applying it
- ThinLTO made this binary larger and moved measured runtime slightly. Keep representative workload, platform and size checks next to the faster build.
Company Playbooks
- Read Anthropic’s playbookRun only affected tests
- Read DoorDash’s playbookRun build and test in parallel, sharded across CI agents
- Read Linear’s playbookBenchmark the same job on faster hardware
- Read Mastra’s playbookStarSling runners for the slowest test workflow
- Read OpenAI’s playbookRank CI fixes by the minutes they save
- Read Ramp’s playbookMove a CPU-bound test suite to a faster CPU
- Read Shopify’s playbookLet an agent iterate against one CI metric
- Read Spotify’s playbookBuild arm64 on native arm64 runners
- Read Stripe’s playbookRun only the tests a change can reach
- Read Uber’s playbookBuild the merge-queue speculations most likely to be needed