03:41
2026-10-08
dev.to
ai-agents
Tiny model. Big decisions. — How I built a 144M-parameter typed decision model that routes 82% of agent decisions off LLMs
A developer built Phocinae-Largha-150M-v1, a 144.3M-parameter typed decision model that answers yes/no, pick-one and 1-10 questions in a single forward pass at 18.6 ms p50 on GPU, scoring 0.797 on Eng…