cd /news/artificial-intelligence/kev-decision-model-in-llama · home › topics › artificial-intelligence › article
[ARTICLE · art-171962] src=dotnetperls.com ↗ pub= topic=artificial-intelligence verified=true sentiment=↑ positive

Kev Decision Model in Llama

A blogger tested Kev, an open-weights decision model distributed as Kev-4B-Q4_K_M.gguf (a 3 GB file based on Qwen 3.5 4B) and served through Llama, which returns JSON answers with probabilities instead of generated text. Asked to classify "the sky is azure" against blue, green, red, black and yellow, Kev returned blue at 0.96 and green at 0.02, with all other colors at 0.006 or below; for "it is night time in the countryside" it returned black at 0.82, blue at 0.08 and red at 0.06, responding instantly in both tests.

key takeaway

A 3 GB Qwen 3.5 4B-based decision model served in Llama returned calibrated JSON probabilities for constrained-choice prompts, scoring "the sky is azure" as blue 0.96 and green 0.02 and "night time in the countryside" as black 0.82, blue 0.08 and red 0.06.

read1 min views2 publishedNov 18, 2026

There has been some excitement over decision models in the AI world lately. A decision model is like an LLM but it does not generate text in its output. It accepts a prompt, but returns JSON output and a list of probabilities—so basically you pass it a question and it responds with the answer (or likelihood of the answers).

Decision models are on the systemone end point. I downloaded Kev-4B-Q4_K_M.gguf, which is an open-weights version of Jev called Kev. It is based on Qwen 3.5 4B, and is only 3 GB. I then set up Llama to use this model.

With curl commands, I can send questions and instructions to the model. For example, I used the question "what color is the sky?" and offered the criteria blue, green, red, black, yellow.

When I used the prompt "the sky is azure", Kev responded with "blue" and "green" with probabilities 0.96 and 0.02; the other colors were all 0.006 or below. So it understood "azure" means blue and green. Then I tried "it is night time in the countryside." Kev responded with the probabilities black (0.82) and blue (0.08) and red (0.06). The model linked "night time" with a dark sky, possibly with blue or red (due to the sunset). It responded instantly in both tests; Kev is a promising way to classify or decide based on prompts.

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @kev 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/kev-decision-model-i…] indexed:0 read:1min 2026-11-18 · —