PaPoo
cover

Human review is becoming the exception, not the default

What surprised me most here is not that Anthropic is leaning hard on automation. It’s that they’re being pretty explicit that “did a human read it?” is no longer the right question for a lot of changes. That’s a real shift in mental model, and I think it’s the only sane one if agents are going to keep multiplying the volume of code. A straight manual-review bottleneck just doesn’t scale to “Claude writes most of Claude Code.”

What I find more interesting, though, is the philosophy underneath the process: move review earlier, spread it across layers, and treat rollback as part of the system instead of a failure mode to be ashamed of. That feels much more mature than the usual “AI reviews everything” pitch. They’re not pretending the machine review is perfect. They’re saying: let the machine catch the routine stuff, let humans handle the risky or ambiguous pieces, and make reversal cheap when the system still misses something. That’s a decent engineering answer, not a marketing answer.

I also like that they measure the thing that actually matters: revert and incident rates. If human approvals go down but breakage stays flat or improves, that’s a real win. If approvals go down and incidents drift up, you’ve just hidden the cost somewhere else. A lot of teams will optimize the visible queue and never look at the blast radius. This piece at least seems aware of that trap.

The part I’m least certain about is how broadly transferable this is. Anthropic has the advantage of building the tools they’re using, with a culture that presumably tolerates a lot of automation and internal dogfooding. That matters. A smaller team, or one without strong CI discipline, may not be able to copy this by just turning on a reviewer bot and hoping for the best. The article hints at that by emphasizing CLAUDE.md, REVIEW.md, verification habits, and rollback, but that’s the hard part. The tool is the easy part. The surrounding discipline is the actual product.

I’d also be curious how often the “verifiers vote on each finding” setup produces false confidence. It sounds good, and maybe it works well in practice, but there’s always a risk that layered automation starts to feel more authoritative than it is. If the model misses a whole class of bug, five agreeing agents won’t save you. Still, I’d rather see this kind of adversarial, layered process than a single-pass AI code review that people blindly trust.

The thing I’d try first, if I were running a team with agent-written code, is not the full Anthropic setup. I’d start with before-PR verification, a strict rollback story, and a very small human-review budget tied to risk. That’s the part of the article that feels most portable. The rest is probably what you earn after you’ve built enough trust in the system.


Reference: How the Claude Code team does code review / claude.dev Blog

同じ著者の記事