SpecPilot: Autonomous Algorithm Discovery and Systems Optimization for Speculative Decoding
A paper titled "SpecPilot: Autonomous Algorithm Discovery and Systems Optimization for Speculative Decoding" questions whether released parallel-drafting systems achieve the full speedup that parallel drafting permits fo…