Accelerating Attention for Ultra-Long Context
A new attention architecture called Latent Sparse Attention (LSA) matches full-attention accuracy at 10M tokens while cutting attention-layer prefill time by 72.4× on an H200 GPU when distilled into Qwen-3.8-27B, accordi…