{"slug": "llm-d-1-0-the-open-source-control-plane-for-vllm-fleets", "title": "llm-d 1.0: The Open-Source Control Plane for vLLM Fleets", "summary": "Llm-d 1.0, an open-source control plane for vLLM fleets on Kubernetes, shipped on October 20 and is being spotlighted at KubeCon North America this week. The project addresses wasted KV cache in multi-replica deployments by subscribing to each vLLM replica's state so routing can account for what is cached where, rather than round-robining requests through a load balancer. The release matters for teams running LLM inference at scale, where redundant prompt-prefix recomputation across five to ten replicas erodes the benefit of prefix caching.", "body_md": "Most teams running LLMs on Kubernetes are quietly burning money. They deploy five or ten vLLM replicas behind a load balancer and call it production. The load balancer round-robins requests. Each replica recomputes the same prompt prefixes it already processed an hour ago. KV cache — the whole point of prefix caching — gets wasted because the router has no idea what’s cached where. llm-d 1.0, which shipped October 20 and is getting its KubeCon North America spotlight this week, fixes that. It is an open-source control plane that sits in front of a vLLM fleet, subscribes to each replica’s […]\n\nThe post", "url": "https://wpnews.pro/news/llm-d-1-0-the-open-source-control-plane-for-vllm-fleets", "canonical_source": "https://byteiota.com/llm-d-1-0-open-source-control-plane-vllm-kubernetes/", "published_at": "2026-11-12 09:08:05+00:00", "updated_at": "2026-11-12 09:20:53.428761+00:00", "lang": "en", "topics": ["ai-infrastructure", "large-language-models", "ai-tools", "mlops", "artificial-intelligence"], "entities": ["llm-d", "vLLM", "Kubernetes", "KubeCon North America"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/llm-d-1-0-the-open-source-control-plane-for-vllm-fleets", "markdown": "https://wpnews.pro/news/llm-d-1-0-the-open-source-control-plane-for-vllm-fleets.md", "text": "https://wpnews.pro/news/llm-d-1-0-the-open-source-control-plane-for-vllm-fleets.txt", "jsonld": "https://wpnews.pro/news/llm-d-1-0-the-open-source-control-plane-for-vllm-fleets.jsonld"}}