cd /news/ai-agents/my-ai-assistant-kept-saying-all-test… · home › topics › ai-agents › article
[ARTICLE · art-160591] src=dev.to ↗ pub= topic=ai-agents verified=true sentiment=· neutral

My AI assistant kept saying "all tests pass". So I built a gate that checks.

A developer built BuildProof, a command-line tool that sits between AI coding agents and a repository to verify that claimed test passes are real, blocking a pass when tests were never run, skipped, or edited to succeed. The tool flips the common CI fail-open default to fail-closed, is installable via npm, and is offered with a 14-day free trial starting at $15 per month.

by read1 min views8 publishedOct 29, 2026

If you code with AI assistants, you've probably seen this: the agent says "done, all tests pass", and then you find out the tests never ran, were skipped, or were quietly edited so they would pass.

I hit this often enough that I stopped trusting the claim and built a tool to check it: BuildProof.

BuildProof is a CLI that sits between the AI and your repo:

Most CI setups fail open: if a step is missing or misconfigured, the pipeline can still go green. With AI agents writing more of the code, that gap gets exploited, usually by accident. BuildProof flips the default. No real proof, no pass.

npm i -g buildproof

There's a 14-day free trial, and plans start at $15/month.

Website: https://buildproof.mgrprosnetwork.com

I'd really like feedback, especially if you can think of ways an AI agent could still sneak a fake "pass" past it. Tell me in the comments.

── more in #ai-agents 4 stories · sorted by recency
── more on @buildproof 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/my-ai-assistant-kept…] indexed:0 read:1min 2026-10-29 · —