04:00
2026-09-04
arxiv.org
artificial-intelligence
Margins, Not Windows: Training-Free Per-Step Lossy Speculative Decoding
Researchers introduced AdaptiveSpec, a training-free per-step speculative decoding method that adapts both draft verification and tree shape from internal decoding signals, improving throughput over Eā¦