Cracking the Code: Making Sense of Neural Network Weights
New research shows that 12-31% of weights in sparse transformers can be clearly interpreted, compared to dense models. An automated pipeline generates human-readable descriptions for each weight, testing them on unseen d…