Natural Language Autoencoders Produce Explanations of LLM Activations
Anthropic researchers introduced Natural Language Autoencoders (NLAs), an unsupervised method that generates natural language explanations of LLM activations by training two modules to reconstruct activations through a t…