# Small Decisions Don't Need a Big Model > Source: > Published: 2026-09-29 04:35:57+00:00 Not every AI feature is a chat. A large share of production calls are a single small decision: is this message spam, which queue does this ticket belong to, does this review score 1 or 5, is this text safe to show. Treating those as a chat completion works, and it is slow, expensive and hard to test. A prompt like "classify this" returns prose you then have to parse. A decision endpoint returns one of the values you named: Structured output is not a formatting preference. It is what makes the call testable: given this input, the answer is one of these five strings. Build a small labelled set before you ship - a few hundred examples is plenty for a narrow task. Then read the confusion matrix, not the accuracy number. Two questions matter: For routing and moderation, a well-calibrated small model beats a stronger model with an unstable prompt. Keep the input format identical between training and production, pin the model version, and re-run the labelled set on every upgrade. If the answers move, you want to know before your users do. Three habits shrink both latency and cost: Automate the reversible decisions first: tagging, prioritising, drafting. Keep a review step for anything that deletes, bans or charges. The model's confidence on a single call is not evidence, and a queue with a human at the end is what lets you turn the automation up later. You do not need a full agent stack to try this: a playground such as [Laya AI](https://laya-ai.pro/) lets you ask a yes/no, choice or score question over short text and inspect the structured answer before wiring the same call into an API. Measure it on your own labelled examples first. If the answer is one of five strings, use a decision call, test it with a confusion matrix, and keep the threshold in your code where you can change it.