17:30
2026-07-28
snowchord.com
artificial-intelligence
Linear Attention, Visualized
Moonshot released Kimi K3, a 2-trillion-parameter model with a 1-million-token context window, in July 2026, using its linear-attention variant Kimi Delta Attention (KDA). The model trails only Claudeβ¦