Researchers introduced InferenceBench, a benchmark where AI agents must optimize LLM inference speed on an H100 GPU within two hours, finding that agents improved up to 8.08× over a naive baseline but…
Average GPU utilization in Kubernetes clusters sits at just 5%, according to the Cast AI 2026 State of Kubernetes Optimization Report, with AKS at 2%, EKS at 5%, and GKE at 6%. An idle H100 GPU on AWS…
A 15% anomaly spike on a $50,000/month Kubernetes cluster adds $7,500 per month, and undetected over a year that single misconfiguration costs $90,000, according to Cast AI data from 23,000+ productio…
An AI agent using the AutoResearch framework autonomously improved a small GPT's training recipe over 123 experiments on a single H100 GPU, achieving a best mean bits-per-byte (BPB) of 0.9774 ± 0.0019…
Reliance Industries announced at its 49th annual general meeting that Reliance Intelligence will commission the first 120 MW of AI compute capacity at a Jamnagar data centre by end 2026, powered entir…
Researchers from Hao AI Lab introduced JetFlow, a speculative decoding framework that breaks the scaling ceiling of autoregressive LLMs by combining one-forward drafting efficiency with branch-wise ca…
Microsoft's Azure cloud platform achieved the fastest AI training results at the largest reported scale, powered by 512 Nvidia H200 GPUs delivering a 28% speedup over prior configurations. The milesto…