NVIDIA released Nemotron-Labs-Diffusion, a single model that eliminates the need for a separate draft model in speculative decoding, achieving 6.82 accepted tokens per forward pass in self-speculation…
AMD announced the acceleration of large-scale LLM inference on its Instinct MI350X/MI355X GPUs using Eagle3 speculative decoding and AMD Quark quantization. The work enables lossless inference speedup…
DeepSeek-AI released DeepSpec, an open-source codebase for training and evaluating draft models for speculative decoding, supporting three draft model algorithms (DSpark, DFlash, Eagle3) and requiring…
DeepSeek open-sourced DSpark, a speculative decoding framework that accelerates per-user generation for DeepSeek-V4 by 57–85% over the MTP-1 baseline. The framework pairs a parallel draft backbone wit…
DeepSeek released DSpark, a speculative decoding framework now live in its DeepSeek-V4 Flash and Pro production API, delivering 51 to 400 percent throughput gains and up to 80 percent latency reductio…