cd/entity/MegaBlocks· home› entities› MegaBlocks
grep -l @megablocks /news/*.json | wc -l → 1

MegaBlocks

mentions 1 type Organization feed RSS

// recent coverage 1 mentions

19:05
2026-07-25
promptcube3.com
machine-learning

MoE Capacity Factor: Why Your Tokens are Being Dropped

Token dropping in mixture-of-experts (MoE) layers occurs when a capacity factor limits each expert's buffer, causing excess tokens to bypass the expert MLP and degrade model quality under production l…

// co-occurs with top 4 entities
MoE 1 DeepSeek-V3 1 TPU 1 XLA 1
// topics top 3 topics
machine learning 1 large language models 1 ai infrastructure 1