Buoyant Releases Kinference: An Open Source Inference Control Plane for Kubernetes and vLLM

Buoyant released Kinference, an Apache 2.0 open-source inference control plane for running vLLM on Kubernetes, adding declarative routing policies, KV-cache-aware load balancing and per-tenant metrics. In Buoyant's own benchmark, Kinference cut median time to first token (TTFT) by 95%.

Buoyant has released Kinference, an Apache 2.0 inference control plane for vLLM on Kubernetes. It adds declarative routing policies, KV-cache-aware load balancing and per-tenant metrics, and cut median TTFT 95% in Buoyant’s own benchmark. The post Buoyant Releases Kinference: An Open Source Inference Control Plane for Kubernetes and vLLM https://www.marktechpost.com/2026/11/07/buoyant-kinference-open-source-inference-control-plane-kubernetes-vllm/ appeared first on MarkTechPost https://www.marktechpost.com .