04:00
2026-08-28
arxiv.org
artificial-intelligence
TreeGraft: Adaptive Multi-Drafter Grafting for Tree-Based Speculative Decoding
Researchers propose TreeGraft, a multi-drafter framework for tree-based speculative decoding that improves large language model inference speed by using drafters of different costs to jointly construc…