Interpretability is becoming increasingly uninterpretable
Anthropic's Natural Language Autoencoders (NLAs), a new interpretability method for large language models, use an activation verbalizer and reconstructor to convert activations into natural language and back, but researc…