04:00
2026-07-24
arxiv.org
large-language-models
Routing Without Training: Controllable-Ratio LLM Offloading via Reliability Gating
Researchers propose CARGO, a training-free routing framework for local-cloud LLM collaboration that uses the local model's own inference-time agreement across sampled responses to decide when to offlo…