- All playbooks
- Review the diff since the last release tag before shipping
Review the diff since the last release tag before shipping
Gate each release on an agent review of the diff between the previous tag and the default branch.
How OpenAI used this technique
Read what OpenAI changed and follow the original sources.
Review the diff since the last release tag before shipping
The release review in the Agents SDK repositories finds the previous release tag, diffs it against the latest main, and has the agent inspect that diff for backward compatibility issues, regressions and the migration or release-note updates a change needs before making an overall release-readiness call. A blocked call comes with a specific unblock checklist. In openai-agents-python#2480 the report sits in the pull request description: a green call, with the Python 3.9 drop rated moderate and the release-note follow-up it requires.
The release pull request carries a release readiness report with a green call, the Python 3.9 drop rated moderate and the release-note follow-up it requires Source
- Use it when
- Releases ship from the default branch after a manual skim of the changelog.
- Before applying it
- Treat a green call as one reviewer's finding and keep the release checks your CI already runs.
Company Playbooks
- Read Anthropic’s playbookRun only affected tests
- Read DoorDash’s playbookRun build and test in parallel, sharded across CI agents
- Read Linear’s playbookBenchmark the same job on faster hardware
- Read Mastra’s playbookStarSling runners for the slowest test workflow
- Read OpenAI’s playbookRank CI fixes by the minutes they save
- Read Ramp’s playbookMove a CPU-bound test suite to a faster CPU
- Read Shopify’s playbookLet an agent iterate against one CI metric
- Read Spotify’s playbookBuild arm64 on native arm64 runners
- Read Stripe’s playbookRun only the tests a change can reach
- Read Uber’s playbookBuild the merge-queue speculations most likely to be needed