04:00
2026-07-07
arxiv.org
large-language-models
Hierarchical Sparse Attention Done Right: Toward Infinite Context Modeling
Researchers propose Hierarchical Landmark Sparse (HiLS) Attention, a chunk-wise sparse attention mechanism that learns chunk selection end-to-end under the language-modeling loss. HiLS-Attention achie…