15:04
2026-07-27
lesswrong.com
artificial-intelligence
MSE loss does not generate superposition
Mean Squared Error (MSE) loss does not incentivize neural networks to encode features in superposition, according to a new analysis by researchers Linda and Phil. The finding, demonstrated through matβ¦