CORAL-KV: Compact Cross-Layer Prediction and Residual Coding for Autoregressive Video KV Caches
Researchers introduced Coral-KV, a KV-cache compression framework that predicts keys and values in later cache layers from earlier layers and quantizes the prediction residuals, according to an arXiv paper (2610.12514v1)…