# A typed classifier out-judges LLMs on agent scoring

> Source: <https://www.vibeleaderboard.ai/intel/brief/2026-09-20>
> Published: 2026-09-20 16:05:16+00:00

LangChain tested TypeSafe AI's Jev, a typed classifier rather than a text-generating LLM, as an agent-eval judge. It matched a human reviewer on every one of 500 repeated decisions while costing a fraction of a cent per call, far less than Claude's LLM-judge cost.
Read: LangChain tested TypeSafe AI's Jev, a typed classifier rather than a text-generating LLM, as an agent-eval judge. It matched a human reviewer on every one of 500 repeated decisions while costing a fraction of a cent per call, far less than Claude's LLM-judge cost.
Watch: Filip Makraduli's FlashNorm folds a transformer's norm layer into its projection weights and overlaps the remaining divide on a separate CUDA stream, cutting norm-plus-projection cost by a third with no retraining needed.
Watch: A rare vLLM bug corrupted about one in a thousand prompts with no error. The cause: a scheduler race let decode run before prefill for Jamba's Mamba layers, computing a fresh request over a stale prior state.
Read: Ben Swerdlow ran 171 real-time StarCraft matches between Codex, Claude, and Grok models, surfacing concrete failure modes in continuous, multi-unit agent control that single-turn benchmarks miss.
Read: PlanetScale released Tin, a GA Postgres extension with boolean, phrase, fuzzy, and BM25-ranked search that keeps correct transactional visibility, cutting a common reason teams bolt on Elasticsearch.
Read: Hacktron's fuller HEIF Heist disclosure shows the libheif bugs behind Tuesday's OpenAI account takeover also reach Slack, Meta, GitHub Enterprise, Rails, and Next.js through indirect dependencies.
