{"slug": "it-passed-every-test-that-s-why-it-can-t-ship-yet", "title": "It Passed Every Test. That's Why It Can't Ship Yet.", "summary": "An engineer's order-reading LLM passed a 29-question exam with zero fatal errors, but the developer refused to ship it immediately because the exam was authored by the same person, covering only imagined scenarios. The developer implemented a guarded deployment where human review catches all results initially, and every miss becomes a new test case, emphasizing that production data reveals the real exam. The process also uncovered five mistakes in the exam itself, showing that the test harness caught more author errors than model errors.", "body_md": "My order-reading LLM passed the 29-question exam. Zero fatal errors. [The model is chosen](https://dev.to/ramses203/the-model-that-costs-3x-more-won-by-exactly-one-question-55aj).\n\nSo — ship it?\n\nNo. And the reason is the most important thing in this series.\n\nThe questions, the answer key, the product catalog — I made all of it.\n\nWhich means \"passed 29 questions\" translates precisely to:\n\n**\"It made no mistakes in the 29 situations I was able to imagine.\"**\n\nNothing more. The sentence I couldn't imagine is not on the exam. And production is a parade of sentences you couldn't imagine. Real customers abbreviate in ways I can't invent, and real product catalogs are far dirtier than the one I wrote — the same product registered three times under different names, dead items nobody deleted piling up for years.\n\nBefore shipping, I wrote these three lines down.\n\n```\nVERIFIED       one question per worst-accident type; both models at zero\nNOT VERIFIED   never ran on production data. Every exam sentence is mine\nGUARDED        when unsure, it must not confirm — it hands off to a human\n```\n\nThe third line is the one that matters. **If the unknown case falls somewhere safe by construction, an incomplete exam is still shippable.** When a never-seen phrasing arrives, this program's worst case is \"slower\" — not \"wrong goods shipped.\"\n\nWithout that guard, shipping on exam scores alone is trusting a gun because it fired 29 times without jamming.\n\nFor a while after launch, nothing passes through automatically. A human reviews every result.\n\nWhat comes out of this period is the real exam. The sentences I couldn't imagine make their first appearance here. Every miss becomes a new exam question. **This is the moment the exam grows from imagination into production.**\n\n```\nWeek 1      humans check everything. Every miss becomes a test case\nWeeks 2–4   if FATAL holds at 0, auto-pass the confirmed ones only\nAfter       humans only see the \"needs confirmation\" queue\n```\n\nThere's an opposite case: FATAL keeps appearing, and the cause isn't the prompt — it's **the question itself.**\n\n\"Figure out what 'the usual' means, automatically\" is that kind of question. It cannot be done in principle. The information isn't there. No amount of prompt polish fixes it, and every polish makes it worse by teaching the model to guess with confidence.\n\nThe move there isn't fixing the program. It's **shrinking the scope.** Draw the line — \"that case goes to a human\" — and automate the rest. Finding out what is impossible in principle is also the exam's job.\n\nCounting what this exam actually caught:\n\nThe model's real mistakes — 1. And its only crime was asking.\n\nThe exam author's mistakes — 5. Three in the answer key, two in the grader.\n\nThe exam I built to verify the AI caught me more than it caught the AI. Which is the real reason to build one.\n\nPassing is the starting line. Production writes the next questions.\n\n*P.S. The scoreboard above changed again later, when the grader got fixed one more time. That story is its own post — it's here.*\n\n*All 29 questions and the grader are public → github.com/ramses203/llm-test-harness*", "url": "https://wpnews.pro/news/it-passed-every-test-that-s-why-it-can-t-ship-yet", "canonical_source": "https://dev.to/ramses203/it-passed-every-test-thats-why-it-cant-ship-yet-3dnm", "published_at": "2026-08-24 00:32:20+00:00", "updated_at": "2026-08-24 01:43:07.077549+00:00", "lang": "en", "topics": ["large-language-models", "ai-safety", "mlops", "developer-tools"], "entities": ["ramses203", "github.com/ramses203/llm-test-harness"], "alternates": {"html": "https://wpnews.pro/news/it-passed-every-test-that-s-why-it-can-t-ship-yet", "markdown": "https://wpnews.pro/news/it-passed-every-test-that-s-why-it-can-t-ship-yet.md", "text": "https://wpnews.pro/news/it-passed-every-test-that-s-why-it-can-t-ship-yet.txt", "jsonld": "https://wpnews.pro/news/it-passed-every-test-that-s-why-it-can-t-ship-yet.jsonld"}}