04:00
2026-09-18
arxiv.org
large-language-models
Block Parallelism For Efficient Distributed Long-Context Diffusion Language Model Training
Researchers introduced block parallelism (BP) and context-sharded block parallelism (CSBP), new distributed parallelism dimensions for training block diffusion language models (BDLMs) on long contexts…