Buoyant has launched Kinference, an open-source control plane that helps IT teams manage and scale AI inference workloads running on Kubernetes using vLLM. By improving GPU utilization, enforcing performance and compliance policies, and enabling selective cloud bursting, Kinference aims to make self-hosted AI infrastructure more efficient and cost-effective.
The post Buoyant Unveils Open Source Control Plane for AI Workloads Running on Kubernetes appeared first on Cloud Native Now.