11:09
2026-06-28
lesswrong.com
neural-networks
Power Laws in NNs: A Possible Mechanism for Inductive Bias towards Sparse Representations
Power-law distributions in neural network weight matrices may explain the inductive bias toward sparse representations, according to research presented under the Iliad Fellowship. The generalized centβ¦