{"slug": "stop-letting-ai-rubber-stamp-your-broken-code-i-built-an-unforgiving-qa-system", "title": "Stop letting AI rubber-stamp your broken code. I built an unforgiving QA system to fix it.", "summary": "Developer Mohamed Saleh has released an open-source AI testing suite designed to stop large language models from rubber-stamping code reviews. The suite forces AI agents through strict phase gates, requires citations for claims, and cross-references runtime errors from Sentry to ensure thorough audits. It includes specialized versions for backend, web, mobile, and desktop applications.", "body_md": "We've all been there. You paste a complex chunk of code into ChatGPT or Claude, ask for a deep security review, and 10 seconds later you get:\n\n*\"Looks great! Your code is well-structured. Good job!\"* \n\nThen you push to staging, and immediately hit a massive CORS error, a memory leak, or a broken state mutation.\n\nLLMs are incredible tools, but fundamentally, they are \"people-pleasers.\" They are inherently lazy. If you don't force them into a corner, they will hallucinate a clean bill of health just to finish the prompt quickly.\n\nI got completely fed up with this. I didn't want an AI cheerleader; I wanted an unforgiving, paranoid Senior QA Engineer.\n\nSo, I spent the last few weeks architecting a strict, open-source workflow to fix this behavior. I built a comprehensive **AI Testing Suite (Prompts & Workflows)** that physically forces LLMs to stop rubber-stamping code and actually audit it. \n\n🛑 **Citation Or It Didn't Happen:** The AI is forbidden from making claims without citing the exact file path and line number. If it can't cite the line, the review is invalid.\n\n🚧 **Mandatory Phase Gates:** It forces the AI through up to 19 strict, methodical gates (Architecture, OWASP Top 10, State Management). It physically cannot skip to phase 2 without printing the completion checklist for phase 1.\n\n🚨 **Real-World Sentry Validation:** It doesn't just guess. The workflow cross-references the AI's static analysis with actual runtime errors from Sentry before deployment.\n\n🕵️ **The Hacker Mindset (Rule 6):** When the AI proposes a security fix, the prompt forces it to act as a Red Team hacker and attempt to bypass its own newly written code.\n\n👀 **Fresh-Eyes Re-Analysis:** Forces a mandatory second-pass audit (acting as a \"different\" reviewer) to catch what it missed the first time.\n\nI built four specialized versions depending on your stack. You just point your AI agent (Cursor, GitHub Copilot, or standard web UI) to the `SKILL.md` file in these repos, and watch the tone and strictness of the AI completely change.\n\n☁️ **Backend & Cloud Auditor Skill**\n\n19 Phases covering Zero Trust, Chaos Engineering, OWASP API Top 10, and advanced forensics.\n\n🌐 **Web App QA & Security Auditor Skill**\n\n13 Phases covering Core Web Vitals, XSS/CSRF/CSP, state mutations, and SEO readiness.\n\n📱 **Mobile App QA Tester Skill**\n\n13 Phases covering iOS/Android specific crashes, memory leaks, and local SQLite/Firebase integrity.\n\n🖥️ **Desktop App QA Tester Skill**\n\n13 Phases covering IPC security (Electron/Tauri), DLL injection prevention, and distribution readiness.\n\nStop letting AI blindly approve your pull requests. Force it to prove its work.\n\nI’d love for you guys to try it out on your next refactor. Fork it, break it, and let me know if your AI still manages to miss bugs!\n\n🤝 **Let's connect on LinkedIn:** [Mohamed Saleh](https://www.linkedin.com/in/mr-mohamed-saleh/)", "url": "https://wpnews.pro/news/stop-letting-ai-rubber-stamp-your-broken-code-i-built-an-unforgiving-qa-system", "canonical_source": "https://dev.to/abosalehworldoss/stop-letting-ai-rubber-stamp-your-broken-code-i-built-an-unforgiving-qa-system-to-fix-it-3kk9", "published_at": "2026-09-06 22:42:47+00:00", "updated_at": "2026-09-06 23:32:49.823131+00:00", "lang": "en", "topics": ["developer-tools", "ai-tools", "ai-agents", "large-language-models"], "entities": ["Mohamed Saleh", "ChatGPT", "Claude", "Cursor", "GitHub Copilot", "Sentry", "OWASP"], "alternates": {"html": "https://wpnews.pro/news/stop-letting-ai-rubber-stamp-your-broken-code-i-built-an-unforgiving-qa-system", "markdown": "https://wpnews.pro/news/stop-letting-ai-rubber-stamp-your-broken-code-i-built-an-unforgiving-qa-system.md", "text": "https://wpnews.pro/news/stop-letting-ai-rubber-stamp-your-broken-code-i-built-an-unforgiving-qa-system.txt", "jsonld": "https://wpnews.pro/news/stop-letting-ai-rubber-stamp-your-broken-code-i-built-an-unforgiving-qa-system.jsonld"}}