Ablation, Statistical Inference, and Validation for KV-Cache Compression
A study comparing Turbo-Quant and SpectralQuant KV-cache compression found that eigenbasis-based methods fail on heavy-tailed data due to covariance instability but excel in structured regimes, with the effective semanti…