HybridInfer: Thermal-Aware Reinforcement-Learning Tier Routing for On-Device, Edge, and Cloud LLM Inference
A thermal-aware reinforcement-learning router called HybridInfer achieved significantly higher response quality than two hand-tuned heuristics (paired Wilcoxon, p < 0.02) at the lowest cost of any ada…