cd /news/ai-tools/i-tested-my-ai-bug-hunter-on-44-real… · home › topics › ai-tools › article
[ARTICLE · art-166203] src=dev.to ↗ pub= topic=ai-tools verified=true sentiment=↑ positive

I tested my AI bug hunter on 44 real bugs from Express, ESLint, Hexo and others. It caught 32.

A developer built BuildProof, an AI bug-hunting tool that attempts to prove a bug exists in a code change rather than guess. Tested against the BugsJS dataset of real bugs from projects including Express, ESLint, Hexo, Karma, Shields, Bower and hessian.js, it caught 32 of 44 re-introduced bugs with no hints, and reported no findings on 4 open pull requests in lodash, koa and axios. The tool runs code in a locked, network-free container that is deleted after each check, and offers a free mode using a local Ollama model.

by read1 min views1 publishedNov 9, 2026

AI writes more and more of our code, and code review can't keep up. So I built BuildProof: a tool that looks at a code change and tries to prove a bug, not just guess one.

BugsJS is a public dataset of real bugs from real projects (Express, ESLint, Hexo, Karma, Shields, Bower, hessian.js). I re-introduced each bug and let the hunter look at the change, with no hints.

It also knows when to stay quiet: I ran it on 4 open pull requests in lodash, koa and axios. It found nothing, and it was right not to. It doesn't invent bugs to look busy.

Your code runs in a locked container with no network and is deleted when the check ends. There's also a free mode that uses your own local model (Ollama).

30-second demo, no project needed:

npx buildproof try

On your own git project (3 free cloud checks):

npx buildproof hunt --base main --cloud

I'd really like feedback, especially on the misses. Which kinds of bugs should it catch that it doesn't?

── more in #ai-tools 4 stories · sorted by recency
── more on @buildproof 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/i-tested-my-ai-bug-h…] indexed:0 read:1min 2026-11-09 · —