{"slug": "i-built-fixproof-to-verify-whether-ai-generated-bug-fixes-are-actually-proven", "title": "I built FixProof to verify whether AI-generated bug fixes are actually proven", "summary": "A developer built FixProof, an MIT-licensed open-source tool that verifies whether AI-generated bug fixes are actually proven by their regression tests. FixProof runs the selected test against committed code before and after a fix, checks for test-integrity warnings, and issues one of four verdicts, currently supporting node:test along with GitHub Actions integration and a browser-based report viewer. The project has reached v1.0.0, and its author is seeking developers using AI-assisted coding tools to test it on real bug fixes.", "body_md": "AI coding tools can generate a fix and tell us the bug is solved.\n\nBut there is an important question:\n\n**Did the regression test actually prove the fix?**\n\nThat question led me to build **FixProof**, an MIT-licensed open-source developer tool for checking the evidence behind AI-generated bug fixes.\n\nFixProof follows a simple proof chain:\n\n**Fail before → pass after → inspect test-integrity warnings → verdict**\n\nIt runs the selected regression test against the committed code before the fix and again against the committed code after the fix.\n\nA passing test after the change is not enough by itself.\n\nFixProof also looks for warning signs such as:\n\nThe goal is to make it harder for a change to appear verified when the regression test never properly reproduced the original problem.\n\nFixProof reports one of four outcomes:\n\nFixProof v1.0 currently supports:\n\n`node:test`\nIt also includes GitHub Actions integration and a browser-based report viewer.\n\nA basic verification looks like this:\n\n```\nnode bin/fixproof.mjs verify \\\n  --repo ../my-project \\\n  --base HEAD~1 \\\n  --head HEAD \\\n  --test tests/regression.test.mjs \\\n  --output fixproof-report.json\n```\n\nFixProof creates a report describing what happened before and after the change and any integrity warnings it found.\n\nThe report can then be opened in the browser viewer.\n\nFixProof does **not** claim that a verified result means the entire application is bug-free.\n\nIt verifies a much narrower question:\n\n**Does the selected regression evidence reliably demonstrate this particular fix within the tested scope and environment?**\n\nI think keeping that boundary explicit is important, especially when AI coding agents are involved.\n\nThe project has now reached **v1.0.0**.\n\n**GitHub:**\n\n[https://github.com/burhanarif472-lgtm/fixproof](https://github.com/burhanarif472-lgtm/fixproof)\n\n**Live demo:**\n\n[https://burhanarif472-lgtm.github.io/fixproof/](https://burhanarif472-lgtm.github.io/fixproof/)\n\nThe project is open source under the MIT License.\n\nI’m now looking for developers who use AI-assisted coding tools to try FixProof on real bug fixes.\n\nI’d especially like to learn:\n\nFinding the limitations is more valuable to me right now than simply collecting stars.\n\nIf you try it, I’d appreciate hearing what works, what breaks, and what you would change.", "url": "https://wpnews.pro/news/i-built-fixproof-to-verify-whether-ai-generated-bug-fixes-are-actually-proven", "canonical_source": "https://dev.to/burhanarif472lgtm/i-built-fixproof-to-verify-whether-ai-generated-bug-fixes-are-actually-proven-41e9", "published_at": "2026-10-23 22:16:47+00:00", "updated_at": "2026-10-23 22:40:02.974604+00:00", "lang": "en", "topics": ["ai-tools", "developer-tools", "ai-agents", "ai-safety"], "entities": ["FixProof", "GitHub Actions", "node:test", "GitHub"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/i-built-fixproof-to-verify-whether-ai-generated-bug-fixes-are-actually-proven", "markdown": "https://wpnews.pro/news/i-built-fixproof-to-verify-whether-ai-generated-bug-fixes-are-actually-proven.md", "text": "https://wpnews.pro/news/i-built-fixproof-to-verify-whether-ai-generated-bug-fixes-are-actually-proven.txt", "jsonld": "https://wpnews.pro/news/i-built-fixproof-to-verify-whether-ai-generated-bug-fixes-are-actually-proven.jsonld"}}