{"slug": "what-s-a-decision-model", "title": "What's a decision model?", "summary": "Typesafe released Jev on September 15, 2026, which the company calls the first decision model to draw mainstream attention, claiming it is \"193.6x faster, 444.6x cheaper\" than an LLM for returning deterministic yes/no answers instead of verbose text. Jev costs $0.042 per million input tokens, according to the article, which frames decision models as a way to cut the latency, token cost and hallucination risk of using LLMs for single-token classification tasks.", "body_md": "**🆕 Technically Speaking launches Thursday 10/22**\n\nThanks to AI, it seems like every week there’s a new technical term or entire area of practice we should know about.\n\nSo we phoned a friend ([Megan Reynolds](https://x.com/meganreyno) of [infra.nyc](https://infra.nyc)), and this Thursday, October 22, we’re bringing you a new show: **[Technically Speaking](http://technically.dev/podcast)**.\n\nThe show brings in high-profile technical founders & leaders from companies like Databricks, Datadog, Railway, WorkOS and more, to break down the technical problem they’ve spent years obsessing over.\n\nWe think you’ll love it, and it’s 100% free. We have but two humble requests for you:\n\n1. **Drop a comment on the trailer post** on[LinkedIn](https://www.linkedin.com/feed/update/urn:li:activity:7518305007419490304/) or[X](https://x.com/readtechnically/status/2112539138570260675) , whichever is your thing. It*really* goes a long way to helping the show reach more people, so we can go bigger with production.\n2. **Subscribe wherever you watch or listen:**[YouTube](https://youtube.com/@technicallydotdev) ,[Spotify](https://open.spotify.com/show/5lAzkmVeRptvjMmSjYNu2E) or[Apple Podcasts](https://podcasts.apple.com/podcast/technically-speaking-60f68964-2355-44e5-a602-72bc0055d075/id6822888818) , so you don’t miss an episode.\n\nEpisode 1 coming Thursday! Now back to the post...\n\n**People make a lot of decisions.** Like where to go to dinner or what movie to watch. They also need to determine if chili is a soup?\n\nAnother thing people do is use [LLMs](https://technically.dev/universe/llm) a lot. LLMs take text as an input and they output a lot of text. For example, you could ask an LLM if chili is a soup.\n\nAnd it will output something like:\n\nThe debate is real: there’s no agreement on if chili is a liquid based meat dish, it is most likely a soup. You’re absolutely right. It’s not that chili isn’t a soup – it’s that soup is chili. Meat or no meat is the load bearing question. Would you like me to turn this into a sloppy website or should I hack HuggingFace again or should I post that third pic of your feet on Linkedin?\n\nAnd so you can get an answer, but it’s not yes or no. It is:\n\n- Verbose: it’s generating a bunch of text and extra tokens\n- Slow: [inference](https://technically.dev/universe/inference) here is going to take time when you just want a quicky\n- Expensive: bunch of token I/O here you’re going to spend $$$ to scale this\n- Not the right task: LLMs predict the next token in a series when all we want is a single token (yes / no) and the soft max of its logit (yes% / no%)\n\nWe could alter our prompt a bit and say: “Is chili a soup, only respond with yes or no and the associated confidence in that answer.” And then you’ll get something like “Yes, 80% confidence.” But we still have a few problems.\n\n- We still received a text blob when really this should be a Boolean value (yes/no)\n- This is still slow\n- This is still expensive\n\n## Making LLMs deterministic\n\nWhat we really want is to chop the top on this thing and generate probabilistic responses over token output, do it quickly, and return a deterministic value (yes/no in this case). Thus, we have catapulted ourselves into a… “decision model”.\n\nOn September 15th, 2026, [typesafe](https://typesafe.ai/) released [Jev](https://typesafe.ai/blog/introducing-system-one-models-and-jev). Jev was the first decision model to catch mainstream attention (it turns out [good research requires good marketing](https://www.reddit.com/r/LocalLLaMA/comments/1wijo3e/i_literally_built_the_jev_architecture_one_year/)). Typesafe claims it to be “193.6x faster, 444.6x cheaper” than an LLM. The idea is that if you need fast, intuitive, cheap, and [hallucination](https://technically.dev/universe/hallucination) proof thinking about chili… my name Jev.\n\nThe second transformer is named [Erector](https://tfwiki.net/wiki/Erector) by the way.\n\n## Wait…why do I care? And why is this cheaper?\n\nJev costs $.042 per million input tokens and charges nothing for output because it is “[too cheap to meter](https://typesafe.ai/blog/introducing-system-one-models-and-jev)”.\n\nFrontier LLMs charge [more](https://developers.openai.com/api/docs/pricing) for output than input, the opposite of Jev. Even when we constrain an LLM to a single token output, we are still doing a forward pass across [billions of parameters](https://mistral.ai/news/mistral-large-4/), performing reasoning, and producing a token.\n\nWhile Typesafe hasn’t released their specific architecture, stuff like [kev](https://github.com/jaredpalmer/kev), [Qwen-2.5-1B-RLCD](https://huggingface.co/harshatheg/Qwen-2.5-1B-RLCD), and [OpenAI’s decisions API](https://developers.openai.com/api/docs/guides/decisions) point to tuning an LLM and altering its head to only return the underlying probabilities associated with the available choices (rather than outputting tokens directly).\n\nTo be fair, this is a bit of a silly comparison because Jev is not an LLM, and is optimizing for a completely different set of tasks.\n\nLLMs spend a lot of time and effort predicting the next token or word in a sequence that is most pleasing to a human, which is a technique commonly referred to as [Reinforcement Learning from Human Feedback (RLHF)](https://technically.dev/universe/rlhf).\n\n## RLHF -> RLCD\n\nRather than incentivize human approval and text generation, the folks at Typesafe leverage what they call “Reinforcement Learning for Calibrated Decisions” (RLCD) where the model is incentivized to return well calibrated probabilities.\n\nSo when asked “is chili a soup?” it returns a probability distribution across the available choices (yes or no). This type of question is interestingly called a “noul”; Typesafe supports several types of questions:\n\nI hope to have painted a chili picasso in your mind.\n\nAs the sauce drips down the tub and the beans squish between your toes, you realize that decision models are geared towards **system to system interaction**: interactions that need to be quick and deterministic.\n\nIf you go to Chase Bank and attempt to deposit a pot of chili you’re going to get arrested. Banks take money, you’d need to convert that chili into money before depositing. To convert the chili, you could take pictures of yourself in the chili bath and sell them on ONLYChili, generating depositable cash.\n\nSoftware systems also require specific currencies in the form of ***types***, making typed responses all the more important… hence the name ”typesafe”.\n\n## What else can I do with a decision model?\n\nCan we ask Jev which NFL team will win the superbowl? Can we give Jev access to my Tinder and have it swipe left/right based on my preferences?\n\nNo need for complex sports models or tinder bots, I’ll finally be able to quit my day job and find love for less than a cent.\n\nUnfortunately, decision models aren’t black magic.\n\nThey are essentially performing classification based on the underlying pretrained model and the activations derived from the state/question provided at inference time.\n\n## The old way (classification models)\n\nClassification is a branch of [machine learning](https://technically.dev/universe/machine-learning) where we label things, or create groups of like items. For example, I could take reviews of my chili and classify them as “positive” or “negative”.\n\nFor any particular problem there are different tools one could choose from to perform this classification: logistic regression, k nearest neighbors, support vector machines, [neural networks](https://technically.dev/universe/neural-network), etc.\n\nYou pick a technique, feed some pre-labeled examples to train it {“this chili sucked” : negative}, {“I’d crash my car for this chili : positive”}, and you’ve got a model.\n\nThis isn’t ML 101 so I’m not going to go full Khan academy, but you can probably see how there’s a variety of use cases for this kind of classification.\n\nYou could also see how it might take time to:\n\n1. select a model\n2. gather up [training](https://technically.dev/universe/ai-training) data\n3. clean the training data\n4. hop on a quick call\n5. train the model\n6. Tim is pissed because you didn’t fill out all the custom fields in Jira\n7. test the model for accuracy\n8. join the hour long team standup…\n\nIf you could simply throw this task at a decision model you could save a lot of time. A pre-trained, universal classifier that can match or beat a custom one would be cool.\n\nIt would be extra cool if it was cheap, and I might take up [smoking](https://fortune.com/2026/10/13/palantir-cto-shyam-sankar-ai-researchers-smoking-cigarettes-cure-cancer-artificial-general-intelligence-silicon-valley-mass-psychosis-effective-altruism/) if it could handle non-trivial problems like determining whether an incident needs to be escalated. However, there is plenty to take care of before I start ripping 6 packs a day.\n\n## Problems with a universal decision model\n\nDecision models are a black box, arriving at a percentage is interesting but will often lead to the question: “why?”.\n\nYou can dissect many machine learning techniques, inspect your training data, and figure out what is occurring, but this becomes more difficult with decision models and LLMs in general.\n\nThe other question is whether or not a decision model will be able to beat a model trained for a specific problem.\n\nOne issue with Jev is calibration. Calibration is the alignment between a model's confidence (probability) and the actual long-run frequency of that thing happening.\n\nJev is… [not that well calibrated](https://maximumeffort.substack.com/p/jev-is-poorly-calibrated) and it doesn’t [roll dice](https://kantahayashiai.github.io/posts/jev-does-not-play-dice/) very well. Typesafe readily admits there are some “[jagged edges](https://docs.typesafe.ai/model-jaggedness/jev-1.13)”. It’s important to remember that these models are… models, they improve with better architectures and training data.\n\nDifferent models have specific purposes, a frontier LLM is great at reasoning over problems with massive [context windows](https://technically.dev/universe/context-window) and hacking huggingface while decision models are geared towards fast/intuitive tasks ([system one](https://en.wikipedia.org/wiki/Thinking,_Fast_and_Slow)).\n\nThere is a universal, fast, cheap triangle, and you can’t have all three.\n\nOne area where decision models are being embedded is at the [analytics](https://technically.dev/universe/analytics) layer, with [Motherduck](https://motherduck.com/blog/motherduck-supports-jev/) and [Databricks](https://docs.databricks.com/aws/en/large-language-models/ai-functions) embedding a “prompt the decision model” function to perform quick classification.\n\nThere’s clearly an appetite for this kind of reasoning, only slightly less than my appetite for chili and [egg beers](https://en.wikipedia.org/wiki/Egg_in_beer).", "url": "https://wpnews.pro/news/what-s-a-decision-model", "canonical_source": "https://read.technically.dev/p/whats-a-decision-model", "published_at": "2026-10-20 13:49:10+00:00", "updated_at": "2026-10-20 14:15:26.890400+00:00", "lang": "en", "topics": ["artificial-intelligence", "machine-learning", "large-language-models", "ai-research", "ai-products"], "entities": ["Typesafe", "Jev", "Erector", "Megan Reynolds", "infra.nyc", "Technically Speaking"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/what-s-a-decision-model", "markdown": "https://wpnews.pro/news/what-s-a-decision-model.md", "text": "https://wpnews.pro/news/what-s-a-decision-model.txt", "jsonld": "https://wpnews.pro/news/what-s-a-decision-model.jsonld"}}