05:34
2026-09-17
aiflash.com
machine-learning
SpectralShift: Effective Context Window Extension of Gated DeltaNet via Spectral Reparameterization
A method called SpectralShift extends the effective context window of Gated DeltaNet, a linear attention architecture used in place of softmax attention for long-context modeling, by reparameterizing …