- All playbooks
- Run an agent review on pull requests
Run an agent review on pull requests
Use an agent to review changes and surface findings before human approval, retaining the team’s review and quality controls.
How companies used this technique
Read what each company changed and follow the original sources.
Have a coding agent review every pull request before a human approves
At Linear, a coding agent takes a crack at reviewing every pull request, and Linear has leaned on Codex for this for the past couple of months. A human engineer then makes the final approval. With agents covering most line-by-line checks, reviewers spend their time on whether the change fits the system and solves the problem the customer reported.
- Use it when
- Pull requests wait for human review, and most of a reviewer's time goes to bugs and logic that an automated reviewer can check.
- Before applying it
- The human approval stays the merge gate, the agent's review is the first read, and the required checks stay as they are.
Build the review bot on the same agent that writes the code
Translated to GitHub Actions
- What Ramp built
- Ramp's code review bot is built on Inspect, its background agents API that also writes pull requests.
- Your GitHub Actions version
- A review agent that reads each pull request with memories of what your team wants reviewed and skill files written by the teams that own the code.
In an August 2026 talk, Ramp's engineers described their own code review bot, built on Inspect, the background agents API that also writes pull requests. The bot pulls from memories of things Ramp especially wants reviewed, and certain teams write their own skill files that look for certain things, which codifies what they have built up over the years.
2026: Ramp's review bot runs on the same background agents API as its coding agent, and teams write skill files for what it checks. Source
- Use it when
- Reviewers repeat the same checks on many pull requests, and the repository can run an agent on each pull request.
- Before applying it
- The bot reviews with the memories and skill files it is given, so keep them current as the team learns what to look for.
- GitHub Actions adaptation
- Compare the source system with your own workflow before applying this translation.
Run an AI reviewer on every commit and post the comments that pass a quality filter
Translated to GitHub Actions
- What Uber built
- Uber's uReview reviews every commit across its six monorepos, with quality and category filters on its comments.
- Your GitHub Actions version
- An AI review job on every commit that posts only the comments that pass a quality filter.
Uber's uReview reviews every commit as part of CI across its six monorepos. It breaks review into comment generation by specialized assistants, quality filtering with a confidence score for each comment, merging of near-duplicate comments, and a category filter that suppresses comment types with low developer value. Comments post inline with Useful and Not Useful ratings, and Uber re-runs the reviewer five times on the final commit to check whether each comment was addressed.
Uber reports that engineers who interact with uReview mark 75% of its comments as useful, and over 65% of its posted comments are addressed. Source
Uber estimates approximately 1,500 hours saved weekly, equivalent to nearly 39 developer years annually. Source
- Use it when
- Reviewers are overloaded by the volume of code from AI-assisted development, and a human first pass is the slowest part of landing a change.
- Before applying it
- Precision keeps authors reading. Tune thresholds per assistant and language from developer ratings, and prune comment categories that attract poor ratings.
- GitHub Actions adaptation
- Compare the source system with your own workflow before applying this translation.
Company Playbooks
- Read Anthropic’s playbookRun only affected tests
- Read DoorDash’s playbookRun build and test in parallel, sharded across CI agents
- Read Linear’s playbookBenchmark the same job on faster hardware
- Read Mastra’s playbookStarSling runners for the slowest test workflow
- Read OpenAI’s playbookRank CI fixes by the minutes they save
- Read Ramp’s playbookMove a CPU-bound test suite to a faster CPU
- Read Shopify’s playbookLet an agent iterate against one CI metric
- Read Spotify’s playbookBuild arm64 on native arm64 runners
- Read Stripe’s playbookRun only the tests a change can reach
- Read Uber’s playbookBuild the merge-queue speculations most likely to be needed