04:55
2026-07-16
thegustafson.com
machine-learning
Seq2seq, Bahdanau Attention, and Why Recurrence Hit a Wall
Researchers proposed the encoder-decoder (seq2seq) architecture for neural machine translation in 2014, but it suffered from a fixed-length bottleneck that degraded performance on long sentences. Bahd…