EAGLE

Google announced a method to retrofit Multi-Token Prediction onto frozen Gemini Nano v3 models, accelerating on-device inference for Pixel 9 and 10 series devices. The approach appends a lightweight T…

Researchers introduced JetSpec, a speculative decoding method that trains a causal parallel draft head on a frozen target model to draft entire speculative trees in one pass while preserving autoregre…