04:00
2026-09-10
arxiv.org
large-language-models
X-CoSD: Communication-Efficient Cross-Vocabulary Collaborative Speculative Decoding
Researchers proposed X-CoSD, a cross-vocabulary collaborative speculative decoding framework for distributed LLM inference that works with heterogeneous small language model and server LLM vocabularie…