- All playbooks
- Agent PR volume
- Reject irrelevant events before allocating runners
Reject irrelevant events before allocating runners
Put event and change conditions before runner allocation so irrelevant comments or edits do not start expensive jobs.
How companies used this technique
Read what each company changed and follow the original sources.
Do not start a runner for irrelevant comments
Mastra gated the major-version job on the exact command in the new or previous comment body. This adapts the non-content-event recipe to issue_comment, preserving command removal as well as addition.
- Use it when
- Comment-triggered automation starts expensive checks for ordinary discussion.
- Before applying it
- Event matching and command parsing must agree. Preserve author authorization, edit/removal handling and fork trust, and keep permission checks separate from event filtering.
Keep metadata edits from restarting source validation
Codex Security skips its source checks on body-only PR edits, gives those events their own concurrency group, and renames the skipped aggregates. Title, base and combined edits still run full validation.
Body-only edits skip source validation in their own concurrency group Source
- Use it when
- Description-only edits rerun the same source checks or cancel an active run.
- Before applying it
- Title validators, retargets and metadata checks still need their events. A skipped run must never overwrite a failed, pending or missing required result.
Skip irrelevant jobs before allocating runners
The Agents SDK already classified each change in a preparation job. Linux and Windows packaging jobs now read that output in a job-level condition, and two explicit Linux jobs keep the versioned required check names when they skip. SDK changes and unknown diffs still run the tests.
Packaging jobs skip at job level for changes outside the SDK Source
- Use it when
- Expensive jobs start only to find that every useful step will skip.
- Before applying it
- Keep stable required check names and require the preparation job to succeed. An unknown diff runs the checks.
Company Playbooks
- Read Anthropic’s playbookRun only affected tests
- Read DoorDash’s playbookRun build and test in parallel, sharded across CI agents
- Read Linear’s playbookBenchmark the same job on faster hardware
- Read Mastra’s playbookStarSling runners for the slowest test workflow
- Read OpenAI’s playbookRank CI fixes by the minutes they save
- Read Ramp’s playbookMove a CPU-bound test suite to a faster CPU
- Read Shopify’s playbookLet an agent iterate against one CI metric
- Read Spotify’s playbookBuild arm64 on native arm64 runners
- Read Stripe’s playbookRun only the tests a change can reach
- Read Uber’s playbookBuild the merge-queue speculations most likely to be needed