13:49
2026-07-23
dev.to
machine-learning
Take your benchmark to the people who can kill it
A developer's MoE model file reordering technique, mbolt, achieved +32.3% decode throughput and −26.3% time-to-first-token on a 235B-parameter model running on a 48 GB MacBook, as independently verifi…