vLLM Semantic Router

A new arXiv study (2608.14641v1) evaluating four open-source model routers across RouterBench, BFCL v4, tau2-bench, and WebArena found that only vLLM Semantic Router varies with prompt content, yet it…

Agentgateway and vLLM Semantic Router (vSR) integrate via external processing (ExtProc) to enable semantic routing of prompts to the most cost-effective LLM model, reducing workload costs by approxima…

A cost-based semantic routing demo combining vLLM Semantic Router (vSR) with agentgateway reduced LLM spend by 35.4% on a 50-prompt Go and Rust coding dataset, according to a developer evaluation publ…

Researchers introduced Session-Aware Agentic Routing (SAAR), a continuity-aware model selection policy for long-horizon LLM agents that adds session memory and safety constraints to vLLM Semantic Rout…