cd /news/ai-tools/your-team-s-coding-rules-aren-t-in-t… · home topics ai-tools article
[ARTICLE · art-122797] src=dev.to ↗ pub= topic=ai-tools verified=true sentiment=· neutral

Your team's coding rules aren't in the prompt, they're in the ingest

A developer argues that AI code reviewers claiming to follow team standards often fail to ground their feedback in actual rule files, instead relying on generic style guides and PR descriptions. The post advises testing whether a reviewer can cite the specific rule it applied and reproduce past review decisions from real config files before deployment.

read1 min views1 publishedSep 8, 2026

Every AI code reviewer claims it respects your team's standards. Very few can tell you what those standards actually are.

The test is mechanical. Ask the tool, or the vendor, one question: where do my rules live? If the honest answer is "we loaded a generic style guide plus whatever your PR description happened to say", then your standards aren't in the model at all. The reviewer is running on vibes and hoping your repo looks conventional enough to pass.

The tools that genuinely track your rules share a shape: the standards are an input, not a hope. They read your rule files, your linter config, your past review comments, sometimes your docs. The review is judged against that artifact, which means when a comment fires you can ask "which rule?" and get a config line back, not a paragraph of model reasoning.

That last part is the thing worth testing for. If a reviewer can't point to the specific rule it applied, it is not following your standards. It is approximating what it assumes standards look like. Those two feel identical for the first six months, then diverge exactly when you've stopped proofreading its output.

A short checklist when you trial one:

If the answer to all four is no, you bought a very chatty spellchecker that happens to be trained on GitHub. The eval that actually decides it: can your own reviewer reproduce one of your team's real past review decisions, given only your real rules file? Run that before you hand it a production PR.

── more in #ai-tools 4 stories · sorted by recency
── more on @github 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/your-team-s-coding-r…] indexed:0 read:1min 2026-09-08 ·