Novelty Cache: The New Frontier in Sequence Models
Researchers have developed a sparse cache approach for sequence models that stores only unique entries, dramatically improving memory efficiency while matching full-attention recall levels. The method, which uses DP-mean…