20:00
2026-08-29
systems.seas.harvard.edu
large-language-models
RouteWise: Latency–Cost Optimization for Multi-Provider LLM Routing
RouteWise, a multi-provider LLM routing system presented by Haoran Ni of Nanjing University, reduces cost by 26.6%, mean time to first token by 58.4%, and SLO violations by 98.2% compared with OpenRou…