An analysis of two Mixture-of-Experts models, Qwen 3.5 35B-A3B and Qwen 3.6 35B-A3B, captured per-token router statistics across every MoE layer using first-turn MT-Bench prompts, recording which experts the router selected and how confident each choice was. The study, published by G.S. Laller, reports expert-selection and router-confidence data by model, color and layer.
/MoE routing G.S. LALLER/Notes
We took the MT-Bench prompts (first turn only), ran inference on each of them with two Mixture-of-Experts models, and captured the statistics of every MoE layer: for each token, which experts the router picked, and how confident that choice was.
Model
Colour by
Layer
data/manifest.json…
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.