22:02
2026-07-29
dev.to
artificial-intelligence
One TPU Chip, Eight Agents: Serving Small Agent Workloads with Raw JAX
A developer built a pure-JAX inference engine for Google's Gemma 4 E2B model after discovering that quantization-aware-trained (QAT) checkpoints fail to load in vLLM on TPU due to a loader bug. The en…