I Benchmarked Speculative Decoding — a = 3.5 Wasn't Enough
A developer benchmarked speculative decoding using Qwen2.5-0.5B-Instruct as the draft model and Qwen2.5-1.5B-Instruct as the target model on a CPU. Across code, JSON, and story generation tasks, speculative decoding was …