23:21
2026-09-28
gslaller.github.io
artificial-intelligence
MoE Analysis Qwen[3.5|3.6]35B-A3B
An analysis of two Mixture-of-Experts models, Qwen 3.5 35B-A3B and Qwen 3.6 35B-A3B, captured per-token router statistics across every MoE layer using first-turn MT-Bench prompts, recording which expe…