04:00
2026-07-30
arxiv.org
large-language-models
Mergeable Model-Side Aggregation States for Long-Context Language Models
Researchers introduced a model-side aggregation interface using Hash-based HyperLogLog (HLL) sketches that maintains compact 2 KiB states alongside frozen language models, achieving 1.6% mean relative…