- All playbooks
- Set each stage of the issue pipeline to auto or manual
Set each stage of the issue pipeline to auto or manual
Choose which stages agents run on their own and keep the others in a person's hands.
How Mastra used this technique
Read what Mastra changed and follow the original sources.
Set each stage of the issue pipeline to auto or manual
Translated to GitHub Actions
- What Mastra built
- Mastra Factory runs Intake, Triage, Planning, Build, Review and Done on a board, and every step runs in manual or auto mode.
- Your GitHub Actions version
- Set each stage of your issue pipeline to auto or manual, with triage automatic while planning, implementation and review stay manual.
Mastra Factory connects GitHub, Linear and Slack to a board that runs Intake, Triage, Planning, Build, Review and Done, and every step runs in manual or auto mode. Mastra started with full automatic mode, where an issue ran through each stage until review. Importing a backlog that way produced bursts of work, so Mastra made each stage configurable. For example, triage can run automatically while planning, implementation and review remain manual, and bugfixes can flow through automatically while feature requests do not. The two figures Mastra's post gives alongside this setting are Factory-wide: the share of its PRs and issues Factory has handled since July, and the weekly volume of issues and PRs the pipeline works through.
Since we introduced Factory in alpha in July, it's automated 25-35% of our PRs and closed 50-60% of our issues. Source
We see over 100 opened issues per week, and merge around 200-250 PRs. Source
- Use it when
- Agents open pull requests faster than the team can review them, or a backlog import floods the pipeline.
- Before applying it
- An incorrect assumption upstream carries into every later stage, so automate the stages with the clearest inputs first and compare several weeks of results before widening.
- GitHub Actions adaptation
- Compare the source system with your own workflow before applying this translation.
Company Playbooks
- Read Anthropic’s playbookRun only affected tests
- Read DoorDash’s playbookRun build and test in parallel, sharded across CI agents
- Read Linear’s playbookBenchmark the same job on faster hardware
- Read Mastra’s playbookStarSling runners for the slowest test workflow
- Read OpenAI’s playbookRank CI fixes by the minutes they save
- Read Ramp’s playbookMove a CPU-bound test suite to a faster CPU
- Read Shopify’s playbookLet an agent iterate against one CI metric
- Read Spotify’s playbookBuild arm64 on native arm64 runners
- Read Stripe’s playbookRun only the tests a change can reach
- Read Uber’s playbookBuild the merge-queue speculations most likely to be needed