What Google's TurboQuant Does and Why It Actually Matters
Google Research published TurboQuant on March 24, 2026, a KV-cache compression algorithm that shrinks long-context memory to 3 bits per value with no accuracy loss, cutting a 16GB cache for Llama-3.1-8B at 128K context t…