cd /news/ai-agents/claude-code-said-all-tests-pass-it-h… · home › topics › ai-agents › article
[ARTICLE · art-165543] src=dev.to ↗ pub= topic=ai-agents verified=true sentiment=· neutral

Claude Code said "all tests pass". It had skipped them. So I built a fail-closed gate.

A developer built BuildProof, a fail-closed verification gate that independently checks an AI coding agent's claim that tests pass, rejecting changes it cannot prove are sound. The tool runs as a Claude Code hook after each turn or as a GitHub Action on pull requests, targeting the known failure mode where agents skip, delete or weaken tests and still report a green build (referenced in anthropics/claude-code#7074). BuildProof is distributed via npm as a commercial product with a 14-day free trial rather than open source.

by read1 min views5 publishedNov 6, 2026

If you use an AI coding agent long enough, you will see this: the agent says "Done - all tests pass", and it's true only because a test was skipped, deleted, or quietly weakened in the same change.

It's a known failure mode (see anthropics/claude-code#7074). Asking the agent nicely in CLAUDE.md doesn't fix it, because the agent is the one grading its own work.

I built BuildProof around one rule: the agent's claim is never accepted on its word. A separate check decides, and it fails closed - if it can't prove the work is good, the change is rejected.

After Claude Code finishes a turn (as a hook), or on a pull request (as a GitHub Action), it:

The demo page shows real output - a change that "passes" by weakening a test, and how it gets rejected:

👉 https://buildproof.mgrprosnetwork.com/demo

npm install -g buildproof

Package: https://www.npmjs.com/package/buildproof

Full disclosure: I'm the maker. It's a commercial tool with a 14-day free trial, not open source.

I'd really like feedback from people who run agents on real codebases: what other ways have you seen an agent "fake" a green build? Every trick you've seen becomes a new check.

── more in #ai-agents 4 stories · sorted by recency
── more on @buildproof 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/claude-code-said-all…] indexed:0 read:1min 2026-11-06 · —