19:34
2026-08-28
sustcsonglin.github.io
artificial-intelligence
DeltaNet Explained (Part 1)
DeltaNet, a new linear attention mechanism introduced in a NeurIPS '24 paper by researchers including Bailin Wang, Yu Zhang, Yikang Shen, and Yoon Kim, replaces the softmax in attention with a delta r…