Is transformer attention really a Hopfield network?
A technical explainer clarifies that one update step of a modern continuous Hopfield network is mathematically identical to scaled dot-product attention, citing the 2020 paper "Hopfield Networks is All You Need" by Ramsa…