- All playbooks
- Put an agent on call to post an evidence-grounded analysis on every CI and CD failure
Put an agent on call to post an evidence-grounded analysis on every CI and CD failure
An agent joins the on-call channel, picks up each CI and CD failure, and posts an analysis grounded in the evidence it found for the person on call to review.
How Anthropic used this technique
Read what Anthropic changed and follow the original sources.
Put an agent on call to post an evidence-grounded analysis on every CI and CD failure
Translated to GitHub Actions
- What Anthropic built
- Anthropic made Claude Tag the on-call first responder, with an orchestration agent and executor subagents writing one situation report in the incident channel.
- Your GitHub Actions version
- A workflow that runs when a required check fails on the default branch or a deploy fails, reads the failed run's logs, the triggering commit and the recent runs of the same job, and posts its analysis for the person on call.
Anthropic made Claude Tag the on-call first responder for CI and CD failures. When an alert is escalated to an incident, an orchestration agent spins up executor subagents that investigate each source of truth, then synthesizes what they find into one situation report in the incident channel. Standing instructions are skills committed in a GitHub repository, and a lessons file the agent appends to is read at the start of every investigation. In GitHub Actions, the same role is a workflow that runs when a required check fails on the default branch or a deploy fails, reads the failed run's logs, the triggering commit and the recent runs of the same job, and posts its analysis, with the lines and runs it relied on, for the person on call.
Claude posts its first evidence-grounded analysis a median of 14 minutes after an incident opens, and in the fastest cases names the root cause within 4 minutes in its first report. Source
- Use it when
- Failures on the default branch or in deploys wait for a person to open the logs, and each investigation starts from scratch.
- Before applying it
- A person stays on call and owns the fix. Start with failures on the default branch, keep the agent read-only, and compare its first analyses with what the person finds before widening it to deploys.
- GitHub Actions adaptation
- Compare the source system with your own workflow before applying this translation.
Company Playbooks
- Read Anthropic’s playbookRun only affected tests
- Read DoorDash’s playbookRun build and test in parallel, sharded across CI agents
- Read Linear’s playbookBenchmark the same job on faster hardware
- Read Mastra’s playbookStarSling runners for the slowest test workflow
- Read OpenAI’s playbookRank CI fixes by the minutes they save
- Read Ramp’s playbookMove a CPU-bound test suite to a faster CPU
- Read Shopify’s playbookLet an agent iterate against one CI metric
- Read Spotify’s playbookBuild arm64 on native arm64 runners
- Read Stripe’s playbookRun only the tests a change can reach
- Read Uber’s playbookBuild the merge-queue speculations most likely to be needed