02:42
2026-07-08
lesswrong.com
large-language-models
the polysemanticity of polysemanticity in language models
Polysemanticity in neural networks arises from superposition, where a single neuron activates for multiple distinct inputs due to insufficient neurons. In language models, this enables efficient repreβ¦