DeltaNet

mentions 2 type Organization feed RSS

// recent coverage 2 mentions

19:34

2026-08-28

sustcsonglin.github.io

artificial-intelligence

DeltaNet Explained (Part 1)

DeltaNet, a new linear attention mechanism introduced in a NeurIPS '24 paper by researchers including Bailin Wang, Yu Zhang, Yikang Shen, and Yoon Kim, replaces the softmax in attention with a delta r…

19:42

2026-08-03

newsletter.semianalysis.com

artificial-intelligence

Kimi K3, The Manos, The Mythos, The Legendos

Moonshot AI released Kimi K3, an open frontier model that swept leaderboards, featuring a hybrid attention mechanism with Kimi Delta Attention (KDA), a linear attention layer derived from DeltaNet and…

// co-occurs with top 8 entities

Moonshot AI 1 Kimi K3 1 Kimi Delta Attention 1 Gated DeltaNet 1 FlashKDA 1 NeurIPS '24 1 Bailin Wang 1 Yu Zhang 1

// topics top 5 topics

artificial intelligence 2 machine learning 2 large language models 2 ai research 2 ai infrastructure 1