04:00
2026-09-30
arxiv.org
artificial-intelligence
SMat-Attention: Structured Long-Context Sequence Modeling
Researchers introduced Structured Matrix Attention (SMat-Attention), a long-context sequence modeling method that uses a family of causal masks with structured long-range routing whose row supports ha…