This is a linkpost for
https://github.com/David-31415/chessformer_interp/blob/main/README.mdI was poking around at a chessformer which mimics human play and made this fun companion app to visualize a lot of the internals of the engine. Check out how attention heads look, how the residual stream evolves, and play around with it if interested!
source & further reading
lesswrong.com — original article
Proof of retention: making weight preservation credible to the models themselves
An analysis of AI-generated content at the Mechanistic Interpretability Workshop
Can risk aversion learned at low stakes generalize to astronomically high stakes?