We're talking past our models; or, How a model defined its "evil" vector as dread
A new study finds that steering vectors in large language models can be interpreted by training neologisms—new tokens with learned embeddings—that allow the model to describe its own internal concepts. Researchers at Ant…