Small Models Can Introspect, Too (2025)
A researcher at Alignment of Complex Systems showed that a 32B open-source model, Qwen2.5-Coder-32B, can subtly introspect when external concepts are injected into its activations, despite appearing unable to do so. By a…