GPU utilization averages just 5% across production Kubernetes clusters, according to the Cast AI 2026 State of Kubernetes Optimization Report, meaning 95% of provisioned GPU capacity is idle at any mo…
KEDA, a CNCF Graduated open-source project created by Microsoft and Red Hat, cuts Kubernetes costs by scaling workloads to zero replicas when no events are pending, a capability standard Horizontal Po…
Kubernetes Horizontal Pod Autoscaler (HPA) automatically adjusts pod replica counts based on real-time demand, addressing the industry-wide issue of average CPU utilization of just 8% across productio…
A developer built Modelplane, an open-source inference control plane using Crossplane, to manage GPU fleets across clouds, neoclouds, and on-premise environments. The platform allows platform teams to…
SkyPilot launched SkyPilot Endpoints, a production-ready LLM inference system that deploys and manages inference across multiple Kubernetes clusters from a single YAML specification. The system handle…
An engineer on Oracle Cloud Infrastructure (OCI) built a scale-to-zero AI inference system on Oracle Kubernetes Engine (OKE) using KEDA to eliminate costs from idle GPUs. The system scales GPU pods do…
Yaron Schneider, CTO of Diagrid Inc. and chair of the Agentic AI Foundation Workflows Working Group, said that standardizing agentic AI infrastructure through open-source foundations is critical to sc…