Component and Dimension Sparsity in Transformer Refusal Mechanisms
A study of four open-weight large language models found that refusal behavior concentrates in sparse component mechanisms comprising 28–48% of upstream attention and MLP components, which retain 88–101% of full steering …