AWS launched EKS Auto Mode at re:Invent 2024 (GA: December 1, 2024), a cluster configuration mode that runs Karpenter as a fully managed, off-cluster service, automating node provisioning, AMI patchin…
CAST AI's 2026 Kubernetes Efficiency Report found CPU overprovisioning jumped from 40% to 69% year over year, and Karpenter's disruption system—consolidation, drift, and expiration—can recover that wa…
Karpenter best practices from CAST AI recommend designing multiple focused NodePools with taints for workload isolation, enabling the SQS interruption queue for Spot, and setting CPU and memory limits…
According to the Cast AI 2025 Kubernetes Cost Benchmark, teams using Karpenter with partial spot configurations save an average of 59% on compute costs, while all-spot configurations save up to 77%. C…
According to the Cast AI 2026 State of Kubernetes Optimization report, which analyzed 23,000+ clusters, the median CPU utilization across autoscaled EKS clusters is 8%, with 69% of Kubernetes clusters…
A developer built a production-safe AI remediation firewall for Amazon EKS, demonstrating how to spread a service across simulated availability zones so that losing an entire zone drops zero requests.…
Karpenter v1.14.0 can autoscale GPU inference on Amazon EKS by provisioning spot GPU nodes on demand, bin-packing a vLLM v0.25.1 model server, and deleting nodes when traffic drops, eliminating static…
GPU utilization averages just 5% across production Kubernetes clusters, according to the Cast AI 2026 State of Kubernetes Optimization Report, meaning 95% of provisioned GPU capacity is idle at any mo…
The Kubernetes Cluster Autoscaler adds nodes reactively when pods are pending and removes them after a sustained underutilization window, with a default scale-down delay of 10 minutes and provisioning…
Red Hat OpenShift 4.22 is now generally available, focusing on cutting cloud infrastructure costs, simplifying operations of virtualized workloads, and securing sensitive data. The release introduces …
Cast AI's 2026 analysis of tens of thousands of production clusters on AWS, GCP, and Azure found average CPU utilization at 8% fleet-wide, down from 10% the prior year. The company identified seven ke…
Karpenter, an open-source node provisioner, directly provisions cloud instances without node groups, while Cluster Autoscaler scales pre-defined node groups. Karpenter is faster, cheaper, and more fle…
By 2026, AI workloads will consume roughly 40% of enterprise Kubernetes clusters, but the default scheduler is ill-suited for GPU-intensive tasks, leading to 30-45% GPU utilization rates and wasted co…
According to the 2026 State of Kubernetes Optimization Report by CAST AI, average CPU utilization in Kubernetes clusters sits at 8% and memory utilization at 20%, meaning roughly 80% of container spen…