Retry only infrastructure failures

Automatic retries are for a lost machine, not for a test shard that timed out.

Prompt

Evaluate and apply this CI technique to my repository: Retry only infrastructure failures.

Automatic retries are for a lost machine, not for a test shard that timed out.

Read the technique and its source-backed company examples: https://starsling.dev/ci-playbooks/techniques/retry-infra-failures-only.md

Inspect this repository’s CI workflows, build and test commands, dependencies, and recent run timings. Identify where this technique applies and explain the expected benefit using this repository’s evidence.
Measure a baseline from recent comparable runs: elapsed time, queue time, runner minutes and failures where available. If data is unavailable, say what cannot be measured.
Compare relevant company approaches, checking prerequisites, platform differences and tradeoffs. Rank applicable options by evidence, fit and measurable opportunity; do not present company results as predictions for this repo.
Recommend the smallest safe change, show what checks and fallback paths remain, and ASK ME WHICH CHANGE TO APPROVE BEFORE EDITING ANY FILES.
Only after approval, work on a new feature branch, make one reversible change, and open a reviewable pull request. Never merge or push to a default or protected branch.
Keep required checks, test coverage, deployment and release behavior intact. Validate the change and compare equivalent runs where possible; report limitations and what should be monitored after merge.

View all playbooks

How Anthropic used this technique

Read what Anthropic changed and follow the original sources.

Retry only infrastructure failures

Bun's automatic retry rules matched every timed-out test shard. The change scopes them to a lost agent, so a shard that times out reports once, with no second run.

Across about 200 recent builds, about 670 automatic retries of timed-out test shards: 465 timed out again and 182 were canceled, which the PR counts as 97% wasted. Source

Use it when: CI retries timed-out or erroring jobs automatically, and most retries end the same way the first attempt did.
Before applying it: Retries stay on for a lost runner or a process that never started.

How Anthropic used this technique

Retry only infrastructure failures

Company Playbooks