Neither Parallel nor Sequential: How DiffusionGemma Commits Tokens
Researchers at Google DeepMind instrumented DiffusionGemma 26B, a masked discrete-diffusion mixture-of-experts model, and found its decoding is neither parallel nor sequential but follows a partial le…