04:00
2026-10-16
arxiv.org
artificial-intelligence
Expanding Attention: A Taylor-Series Route to Linear-Time Transformers with a Fixed Number of Recurrent States
A new arXiv paper (2610.20637v1) presents a Taylor-series expansion of the attention exponential kernel that collapses causal history into exactly n recurrent states, each updated by one rank-one oute…