Review every pull request with AI agents before a human looks

The Claude Code team at Anthropic routes every PR through Claude review, security checks and risk-tiered human approval; merged PRs more than doubled from June to September while reverts fell over 40 percent.

Done withClaude CodeinGitHub· Oct 15, 2026 · 2 accounts

What they did

Addy Osmani, Morgan Westlee Lunt and Qing Wang describe how the Claude Code team reviews code now that Claude writes about 90 percent of it. Before a PR exists, Claude is asked to run tests, a build or a screenshot comparison and show the output, then a subagent with fresh context reviews the diff, and authors run internal skills that hunt bugs, simplify the diff and check behaviour end to end. Every PR then gets a Claude review in which several agents look for bugs and a separate group votes on each finding before it is posted inline, tagged Important, Nit or Pre-existing. A security review can block the merge. A classifier sorts each change into a low, medium or high risk tier that sets whether zero, one or two people must approve, and agents often pick up review findings overnight. Review agents also sweep existing code nightly.

How it went

From June to September merged PRs to the Claude Code codebase more than doubled and the share that had to be reverted fell by more than 40 percent. When the reviewer launched internally, PRs with substantive review comments went from 16 to 54 percent. Most PRs over 1,000 lines get findings and most small ones come back clean. One CLI PR went through more than fifty overnight rounds of agent review and fixes before its author stopped it, and about 59 percent of repeat flags were old code, so they capped re-review at three rounds and switched to diff-only passes.

Worth knowing

This is Anthropic writing about its own product, so the numbers are self-reported. Past incident PRs became a daily eval for the reviewer, and noise is measured by how authors respond to each comment. HN commenters were sceptical of change counts as a metric, and one pointed out that the open-source security review action says it is not hardened against prompt injection.

Try it

With Claude Code· 3 parts to fill in

Review the open pull request on [repo] against the whole codebase and the PR description. Read CLAUDE.md and any REVIEW.md first and follow them. Look for bugs the change introduces, check that a bug fix addresses the root cause, and run [the test command] to confirm. Report each finding with a file and line as evidence, tagged Important, Nit or Pre-existing, starting with a count, and say plainly if there is nothing to fix. Do not repeat findings already posted on earlier rounds, and after [three] rounds stop and ask the author to reconsider the approach instead of reviewing again. Do not merge anything.

Square brackets are the parts to fill in. The prompt is ours; the story is theirs.

Where they said it

Related