{"slug": "headvis-plus-nla-contributions-and-more-saes", "title": "HeadVis, plus NLA Contributions and more SAEs", "summary": "Neuronpedia launched HeadVis, a tool for exploring attention heads in collaboration with Anthropic, now available for 37 models with over 36,000 attention head dashboards. The platform also added new SAEs and NLAs, including contributions from Francesco Zaffino and Caleb DeLeeuw, with compute support from Modal.", "body_md": "*This post is human-written and not AI generated or edited.*\n\nHey all! We're introducing a new Neuronpedia core feature for exploring attention heads in collaboration with Anthropic, and we also provide a few updates to NLAs and SAEs, as well as a quick poll in the end.\n\nHeadVis ([Luger, Kamath, et al](https://transformer-circuits.pub/2026/headvis/index.html)) is Anthropic's tool for exploring attention heads, and it's now available for 37 models on Neuronpedia, for a total of 36,000+ attention head dashboards.\n\nLet's examine an [induction head](https://www.neuronpedia.org/qwen3.5-0.8b/head/4/5?headFinder=true) (an attention head responsible for repeating previously seen token patterns like [A][B]...[A]->[B]) in [Qwen3.5-0.8B](https://www.neuronpedia.org/qwen3.5-0.8b/head/4/5?headFinder=true):\n\nIn the sequence above, the species name \"Glenea anticepunctata\" is repeated multiple times. As we hover over the tokens in its name, the orange lines show the attention head looking back at previous copies of the species name (specifically, the token immediately after the previous instance of the current token) so it knows what to output next. The grey lines show the opposite: where the hovered token is being referenced by a future token.\n\nThe rest of the attention dashboard shows other metrics and visualizations such as self attention score, max attenetion distribution, and top query and key tokens.\n\nThis Qwen 3.5 model has 24 layers and 8 heads per layer, for a total of 192 attention heads, so how did we find an induction head? The **Head Finder** (enabled by clicking \"Finder\" on an attention head dashboard) lets us find top N heads by notable, precomputed metrics. In this case, we filtered by top **induction scores** of all heads - calculated by averaging the induction-pattern attention values across many sequences.\n\nHere's the Head Finder in action:\n\nSince HeadVis is a core Neuronpedia integration, there are a few ways to access and share attention head dashboards:\n\n[Read Post (LessWrong)](https://www.lesswrong.com/posts/AtbZQuAn2iY2jCup2/explaining-sae-features-with-foreign-natural-language) | [Notebook](https://colab.research.google.com/drive/1VM-rDr9MleWzzwiGzr5rAnA8NiR33aKI#scrollTo=Hnf_egPFGrPu)\n\nContributor Francesco Zaffino previously demoed ([notebook](https://colab.research.google.com/drive/1DYXHO61ns2iDmiySYrp9VRFzYKMYItxI?usp=sharing)) using Gemma's NLA to explain SAE features. His new post extends this experiment in two ways:\n\nCheck out [the post](https://www.lesswrong.com/posts/AtbZQuAn2iY2jCup2/explaining-sae-features-with-foreign-natural-language) and the associated [notebook](https://colab.research.google.com/drive/1VM-rDr9MleWzzwiGzr5rAnA8NiR33aKI#scrollTo=Hnf_egPFGrPu).\n\nContributor Caleb DeLeeuw is working on NLAs for Gemma 4 E2B, and has trained a few versions of it. Surprisingly, the NLAs were trained on a 4GB consumer GPU! These NLAs are still a work in progress, but there are two versions for experimentation:\n\nExample code for running these NLAs is [available here](https://github.com/SolshineCode/nla-gemma-4-e2b/blob/main/examples/round_trip_example.py).\n\nCombined with the new SAEs from the last newsletter, here are the 14 new SAEs available on Neuronpedia, all with auto-interp explanations and available via our [exports](https://neuronpedia-datasets.s3.us-east-1.amazonaws.com/index.html?prefix=v1/).\n\nOur thanks to [Modal](modal.com) for generously providing the compute used to train the Qwen 3.5 0.8B and 4B SAEs.\n\n| Model | Layer | Link |\n|---|---|---|\n| Gemma 4 31B | 30 |\n|\n\nNeuronpedia currently runs >20 models for live inference, steering, graph generation, circuit tracing, and now NLAs in the API and on our interface. Which of the models do you care about the most, and which models should we add? Please take a minute toe answer the one question poll so that we can prioritize the models that you care about the most.\n\nAs always, please [contact us](https://www.neuronpedia.org/contact) with your questions, feedback, and suggestions.", "url": "https://wpnews.pro/news/headvis-plus-nla-contributions-and-more-saes", "canonical_source": "https://www.neuronpedia.org/blog/headvis", "published_at": "2026-06-09 00:00:00+00:00", "updated_at": "2026-07-07 20:33:37.027267+00:00", "lang": "en", "topics": ["artificial-intelligence", "machine-learning", "neural-networks", "ai-research", "ai-tools"], "entities": ["Neuronpedia", "Anthropic", "Qwen3.5-0.8B", "Gemma 4", "Francesco Zaffino", "Caleb DeLeeuw", "Modal"], "alternates": {"html": "https://wpnews.pro/news/headvis-plus-nla-contributions-and-more-saes", "markdown": "https://wpnews.pro/news/headvis-plus-nla-contributions-and-more-saes.md", "text": "https://wpnews.pro/news/headvis-plus-nla-contributions-and-more-saes.txt", "jsonld": "https://wpnews.pro/news/headvis-plus-nla-contributions-and-more-saes.jsonld"}}