JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Parallel Tree Drafting
Researchers introduced JetSpec, a speculative decoding method that trains a causal parallel draft head on a frozen target model to draft entire speculative trees in one pass while preserving autoregressive factorization.…