13:47
2026-09-22
sebastianraschka.com
large-language-models
MiMo-V2.6 Pro Architecture and Training Notes
Xiaomi's MiMo-V2.6 Pro ranks No. 1 on open-weight benchmarks by weighted average despite using a classic Grouped Query Attention architecture with Sliding Window Attention at a 128-token window, accorβ¦