cd /news/artificial-intelligence/blockserve-block-grained-continuous-… · home topics artificial-intelligence article
[ARTICLE · art-56870] src=arxiv.org ↗ pub= topic=artificial-intelligence verified=true sentiment=↑ positive

BlockServe: Block-Grained Continuous Batching for High-Throughput Diffusion LLM Serving

BlockServe, a continuous batching framework for diffusion large language models (dLLMs), achieves 1.9–10.6× throughput over Fast-dLLM across five benchmarks by integrating block-grained scheduling, mixed-state execution, and a compute-aware admission controller, as detailed in a new arXiv preprint (2607.08930v1). The framework addresses convergence heterogeneity in dLLM serving, eliminating compute bubbles and tail latency from straggling requests.

read1 min views52 publishedJul 13, 2026

arXiv:2607.08930v1 Announce Type: new Abstract: Efficient serving of diffusion large language models (dLLMs) is hindered by convergence heterogeneity: when batching multiple requests, different sequences converge at different rates, causing faster requests to stall behind slower stragglers and introducing compute bubbles and tail latency. We present BlockServe, a continuous batching framework that integrates block-grained scheduling -- immediately evicting completed requests at block boundaries -- with mixed-state execution that extends dual cache and parallel decoding to heterogeneous batches via gather-scatter indexing. Furthermore, a compute-aware admission controller expands effective batch capacity through token-budgeted refill. On Dream and LLaDA across five benchmarks, BlockServe achieves 1.9--10.6$\times$ throughput over Fast-dLLM with comparable generation quality, establishing block-grained scheduling as a foundation for high-throughput offline dLLM inference.

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @blockserve 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/blockserve-block-gra…] indexed:0 read:1min 2026-07-13 ·