Kimi Linear: An Expressive, Efficient Attention Architecture — interactive visual explainer | Rudrite Research
The Kimi Team published a new attention architecture, Kimi Linear, on arXiv in 2025. The architecture uses Kimi Delta Attention interleaved 3:1 with full attention, becoming the first linear hybrid to outperform softmax …