{"slug": "i-built-an-ai-code-review-github-app-that-tracks-your-team-s-mistake-patterns-s", "title": "I built an AI code review GitHub App that tracks your team's mistake patterns, here's how", "summary": "Ahmad Mustafa built CodePulse, a GitHub App that analyzes pull requests and tracks recurring code issues per developer over time. The app runs a two-pass AI analysis using Groq's Llama 3.3 70B model, stores findings per developer, and sends personalized weekly email digests summarizing each person's recurring mistake patterns. CodePulse is live at getcodepulse.vercel.app and open-source on GitHub.", "body_md": "Most AI code review tools tell you what's wrong in a PR. CodePulse tells you what your team keeps getting wrong, week after week.\n\nI built CodePulse as a GitHub App that does two things regular code review bots don't: it stores every finding per developer over time, and sends a personalized weekly digest summarizing each person's recurring issue categories. The idea is simple — if you're writing the same type of bug every week, you should know about it.\n\n**How it works**\n\nInstall the GitHub App on your repos. Every time a PR is opened, CodePulse fetches the diff, runs a two-pass AI analysis using Groq's Llama 3.3 70B with structured tool-calling, and posts inline review comments pinned to exact lines with severity labels — Critical, High, Medium, Low.\n\nEvery finding gets stored against the developer who wrote it, the repo, and the PR. This is what makes CodePulse different from a one-shot reviewer — it builds a history.\n\nEvery Sunday, developers who opt in get a personalized email digest aggregating their issue categories from the past week. Not a wall of comments — a summary of patterns.\n\n**The Stack**\n\nBackend runs on Node.js, Express, TypeScript with Prisma ORM and Neon PostgreSQL on Azure. Frontend is React with TanStack Router on Vercel. Weekly digests go out via Resend, triggered by a GitHub Actions cron job.\n\nThe trickiest part was the two-pass analysis — a file triage pass first to skip lockfiles, minified assets, and generated files, then a chunked deep review pass that returns typed JSON per issue via structured tool-calling. Getting Groq to return consistent structured output at speed was the core engineering challenge.\n\n**What I learned**\n\nWebhook reliability is everything in a GitHub App. HMAC-SHA256 verification, idempotent processing, and logging every delivery from GitHub's Advanced tab saved me hours of debugging. If you're building on GitHub webhooks, treat the Recent Deliveries panel as your best friend.\n\nMulti-tenant isolation also required more upfront schema design than I expected, scoping every query by GitHub App installation ID from day one is non-negotiable.\n\n**Try it**\n\nLive at getcodepulse.vercel.app — install the GitHub App on any repo and open a PR. Inline comments appear within 1–3 minutes.\n\nSource on GitHub: github.com/ahmadmustafa02/CodePulse\n\nI'm Ahmad Mustafa, a Full Stack Developer based in Islamabad, Pakistan. Building AI-powered products and publishing research in deep learning for IoT security and medical imaging.", "url": "https://wpnews.pro/news/i-built-an-ai-code-review-github-app-that-tracks-your-team-s-mistake-patterns-s", "canonical_source": "https://dev.to/ahmadmustafa/i-built-an-ai-code-review-github-app-that-tracks-your-teams-mistake-patterns-heres-how-1ni", "published_at": "2026-06-12 05:36:15+00:00", "updated_at": "2026-06-12 05:41:53.366269+00:00", "lang": "en", "topics": ["ai-tools", "ai-products", "ai-startups", "large-language-models", "artificial-intelligence"], "entities": ["CodePulse", "GitHub", "Groq", "Llama 3.3 70B", "Node.js", "Express", "TypeScript", "Prisma"], "alternates": {"html": "https://wpnews.pro/news/i-built-an-ai-code-review-github-app-that-tracks-your-team-s-mistake-patterns-s", "markdown": "https://wpnews.pro/news/i-built-an-ai-code-review-github-app-that-tracks-your-team-s-mistake-patterns-s.md", "text": "https://wpnews.pro/news/i-built-an-ai-code-review-github-app-that-tracks-your-team-s-mistake-patterns-s.txt", "jsonld": "https://wpnews.pro/news/i-built-an-ai-code-review-github-app-that-tracks-your-team-s-mistake-patterns-s.jsonld"}}