04:00
2026-07-28
arxiv.org
artificial-intelligence
What Softmax Throws Away: Mass-Aware Attention for Evidence Accumulation
A new study from arXiv identifies a fundamental limitation in standard attention mechanisms: when evidence patterns repeat, the numerator and denominator grow at the same rate, causing inputs with dif…