SparQ

Researchers introduced Fathom, a per-query read-depth key scan for sparse decoding over offloaded KV caches, which at one million tokens on Qwen3-8B runs a decode step 1.67x faster in GPU time than th…