cd /news/ai-agents/i-made-two-ais-review-each-other-s-c… · home topics ai-agents article
[ARTICLE · art-128079] src=dev.to ↗ pub= topic=ai-agents verified=true sentiment=↓ negative

I made two AIs review each other's code for 30 days. A human still caught the bug in 5 minutes.

A developer ran a 30-day experiment in which one AI agent wrote code and a second, independently prompted AI agent reviewed it, logging 41 real issues that a competent reviewer should have caught. The skeptic agent caught architecture drift, swallowed errors, and a race condition, but missed all three silent data-integrity failures on the unhappy path — including a Stripe webhook handler that acknowledged events before persisting them, which it approved and praised for low latency. The developer concluded that because both agents came from the same model family, the reviewer shared the author's blind spots and re-derived them rather than refuting them.

by read6 min views1 publishedSep 13, 2026

Last month I let AI write 100% of my code for 30 days. The single loudest lesson wasn't "AI is amazing" or "AI is useless." It was one sentence: the thing that writes the code can never be the thing that reviews it. A model grades its own homework and it always passes.

So this month I did the obvious next experiment. If the author can't be the reviewer — fine. Make a second AI the reviewer. Author agent writes the feature. A separate skeptic agent tries to tear it apart. No human in the review loop at all, on purpose, to find out how far the structure alone could carry me.

It worked far better than I expected. Right up until the one moment it mattered most.

Two agents, deliberately given different jobs — because I'd already learned the hard way that "independence" is not a second prompt to the same model asking "is this correct?" It just agrees with itself in a calmer voice.

Different frame, different objective. A grader looks for reasons to say yes; a skeptic hunting for the failure looks for the one input that breaks it. That gap is the whole reason the second agent is worth its tokens.

I logged everything for 30 days. Every issue the skeptic caught, every issue it missed that I caught in my own final read, every false alarm. 41 real issues that a competent reviewer should have caught. Here's the honest scoreboard.

This is the part that surprised me, so let me be fair to the machine first.

Architecture drift, gone. The author wrote a second formatCurrency because it didn't know the first existed. The skeptic, pointed at the whole diff and told to "find what this reimplements," caught it in one pass. Same with an inline auth check that duplicated my middleware, and a subtly-different User type in a new module. The stuff that compiles, passes, and quietly rots your codebase — the skeptic was genuinely good at it, better than a tired human at 6pm.

Swallowed errors, flagged. The author's instinct is to wrap everything in try/catch and move on. The skeptic's adversarial frame — "what failure does this hide?" — caught the catch blocks that logged and continued as if nothing happened.

A real race condition. Two requests, one counter, no lock. The author never sees it because it works every time in testing. The skeptic reasoned about concurrent callers because I'd told it to assume the worst input, and the worst input is two of them at once.

If I'd stopped here I'd be writing the "you don't need human reviewers anymore" post. Eight of nine break-classes from last month's experiment, caught by a machine, for pennies. Then I looked at the three it missed. All three survivors were the same kind of bug: a silent data-integrity failure on the unhappy path. The flagship was one you've heard me tell before, because it keeps happening and it keeps being the one that matters.

The author wrote a Stripe webhook handler that acknowledged the event before persisting it. Return 200 to Stripe, then write the row. Works flawlessly in every test. In production, one database blip between the ack and the write = a paying customer with access to nothing and no record they ever paid. Stripe considers it delivered. Your DB never heard about it.

I fed that exact handler to the skeptic, with its adversarial brief, and asked it to find the input that loses a customer money.

It approved it. Confidently. It even praised the "clean early acknowledgement to keep webhook latency low."

Here's the thing I actually want you to take away, because it's not "the AI wasn't smart enough."

The author and the skeptic are the same model family. Same training distribution, same instincts, same idea of what "clean webhook code" looks like. The author thought ack-before-persist was fine. And when I handed that code to the skeptic, the skeptic shared the exact mental model that thought it was fine. It didn't refute the blind spot. It re-derived it, in a more confident voice, and called it a strength.

That's not a review. That's an echo with better manners.

"Author ≠ reviewer" is necessary. It is not sufficient. If both agents reason from the same prior, the second one isn't a check — it's the first one wearing a lab coat. Point them both at a bug that lives inside their shared blind spot and they will agree, twice, and hand you a green checkmark over a landmine.

I gave the same handler to a senior engineer. No special prompt, no framing. She read it, went slightly pale, and said: "it acks before it writes — I got paged for exactly this in 2021, it's a nightmare to reconcile."

Five minutes. And notice why. It wasn't that she was smarter than the model, or reasoned more carefully. She'd been burned. She had scar tissue the model doesn't have and can't get, because you can't train the memory of a 2am reconciliation into a context window. The model has read a million descriptions of the dual-write problem. She has lived one. Those are not the same knowledge, and the difference is the entire margin.

That's the missing rung again, by the way — the one I keep coming back to. The reason she could catch it is that early in her career she shipped something like it and paid for it. If AI does all the entry-level work, nobody accumulates that scar tissue, and then nobody can catch the bug that the two agents will keep waving through. The skeptic and the senior aren't interchangeable. One pattern-matches on everything it's read; the other remembers what hurt.

So the second agent isn't useless — it caught 38 of 41, and I'd never ship without it now. But the experiment taught me exactly where its ceiling is, and how to raise it. Independence isn't a second seat. It's divergence, and you can buy it in three places:

Stack all three and the blind spot has nowhere to hide, because a bug has to survive a different model, an adversarial objective, and a human who's paid for it before. Any one of those alone, and the landmine ships with a green check on top.

Last month I asserted this structure. This month I have the log that proves it:

That's not a prediction about which model wins. It's a structure, and it holds whether the author is today's model or something we haven't built yet — because it doesn't depend on the model being good. It depends on the model being checked by something that fails differently than it does.

It's also, not coincidentally, exactly how we build xenition: an agent that does the work, a different agent that tries to tear it down, and a person who owns the merge. I didn't arrive at that from a thesis. I arrived at it from 30 days of watching two AIs agree with each other over a bug a human spotted in five minutes.

The two-agent setup caught 38 of 41. The 39th is why there's still a person on the merge button — and why there needs to keep being one who's been burned.

Four questions I'd genuinely like answered in the comments:

── more in #ai-agents 4 stories · sorted by recency
── more on @stripe 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/i-made-two-ais-revie…] indexed:0 read:6min 2026-09-13 ·