A developer has built an open-source AWS DevOps agent for SRE on-call engineers that automatically gathers context when a Kubernetes alert fires and sends an LLM-generated root-cause hypothesis to Tel…
A developer built the AWS Solutions Architect Prover, an MCP server that reviews AI-generated cloud architectures against five mandatory gates derived from the AWS Well-Architected Framework. The tool…
Shaide, a Kubernetes-native AI platform for distributed multi-model inference, has been released under the Apache 2.0 license. It uses vLLM for inference, llm-d for orchestration, KV-cache-aware sched…
Axem co-founders open sourced Shaide, a Kubernetes-native AI platform for distributed multi-model inference, under the Apache 2.0 license. The platform uses vLLM for inference and llm-d for orchestrat…
A developer detailed a production-grade GitOps architecture on AWS that uses separate EKS clusters per environment, ECR as the registry, OIDC federation instead of static credentials, and Kargo to aut…
AWSBuilder engineers detailed a policy-enforced EKS control plane that separates AI-driven incident diagnosis from production authorization. The architecture uses Cedar policies via Amazon Verified Pe…
A team demonstrated an AI agent orchestrating a complete migration of 1 TB of production data from Elasticsearch 7.10 to OpenSearch 3.x on Amazon OpenSearch Service in 33 minutes. The agent, using Kir…
Engineers at an unnamed company cut inference cold start times from minutes to seconds by profiling their startup sequence and finding that 90% of the delay came from moving large files. They reduced …
Teams running Spot-heavy Kubernetes configurations save 77% on compute on average, compared to 59% for mixed fleets, according to the 2025 Cast AI Kubernetes Cost Benchmark. AWS gives a 2-minute inter…
According to the Cast AI 2026 State of Kubernetes Optimization report, which analyzed 23,000+ clusters, the median CPU utilization across autoscaled EKS clusters is 8%, with 69% of Kubernetes clusters…
An SRE engineer cut 3 hours of weekly toil to 20 minutes using Claude Code, a terminal-native AI agent from Anthropic that executes shell commands, reads files, and edits configs with user approval. T…
Average GPU utilization in Kubernetes clusters sits at just 5%, according to the Cast AI 2026 State of Kubernetes Optimization Report, with AKS at 2%, EKS at 5%, and GKE at 6%. An idle H100 GPU on AWS…
GPU utilization across production Kubernetes clusters averages just 5%, yet half of GPU cloud providers surveyed by SemiAnalysis report being completely sold out of H100 and H200 capacity, according t…
Graviton ARM instances are approximately 19% cheaper per vCPU than equivalent Intel x86 on-demand, and ARM nodes in Kubernetes clusters grew 3.5x faster than x86 between Q2 2024 and Q4 2025, now accou…
Modelplane released v0.2 of its open-source inference orchestration platform, adding support for Nebius and Azure AKS cloud providers, weighted request routing for canarying and traffic splitting, and…
A new Kubernetes cost optimization checklist reveals that average CPU utilization across production clusters is only 8% in 2026, down from 10% the prior year, with 69% of clusters over-provisioning CP…
Karpenter, an open-source node provisioner, directly provisions cloud instances without node groups, while Cluster Autoscaler scales pre-defined node groups. Karpenter is faster, cheaper, and more fle…
Hacktron researchers discovered critical vulnerabilities in Metabase Cloud that could have allowed attackers to compromise all cloud tenants. By exploiting flaws in H2 database connection handling and…
A developer at a Fortune 100 manufacturer describes the production guardrails for enterprise AI agents, emphasizing that the most critical controls are pre-existing infrastructure like IAM, network eg…
A new tool called Architect migrates Valkey containers between spot instances in under 10 seconds, preserving all in-memory data when a spot reclamation notice is received. This allows stateful worklo…