MLCommons released MLPerf Inference v6.1 on September 16, adding two new benchmarks: an End-to-End RAG test that times a full retrieval pipeline (embedder, vector database, reranker, and LLM stages) a…
AMD published a step-by-step recipe for reproducing its MLPerf Inference v6.1 submission results on AMD Instinct MI355X, MI350X, and MI350P GPUs, marking the company's fifth consecutive round of MLPer…
MLCommons published MLPerf Inference v6.1 with a record 30 submitting organizations and 486 datacenter and edge results, including the first peer-reviewed numbers for NVIDIA's Vera Rubin NVL72, AMD's …
MLCommons published MLPerf Storage v3.0 results, adding checkpointing and two inference workloads for the first time, with 19 organizations submitting 143 results and 11 first-time submitters. Everpur…
MLCommons released version 3.0 of its MLPerf Storage benchmark, adding an S3 data layer, KV Cache, and vector database workload tests to better reflect modern AI data systems. The update includes four…
Google DeepMind piloted what it calls the first double-blind evaluation of a proprietary frontier AI model, using cryptographic protections to keep both the model and test prompts hidden from each sid…
Google introduced the world's first double-blind evaluation of a proprietary frontier-class AI model, testing a Gemini Flash Lite model against confidential benchmarks in a cryptographically secure en…
On June 12, 2026, Artificial Analysis, in collaboration with NVIDIA, released AA-AgentPerf, a benchmark that introduces 'Agents per Megawatt' as a primary metric for agentic AI hardware performance. I…
Google Cloud is collaborating with MLCommons through the MedPerf initiative to use Confidential Computing for privacy-first benchmarking of medical AI models, enabling validation on diverse real-world…
MLCommons added an Agentic Inference benchmark to MLPerf on July 8, 2026, measuring how LLM serving systems handle multi-turn agent tasks with growing context and tool use. The benchmark uses 490 codi…
NVIDIA swept MLPerf Training v6.0 benchmarks, achieving the fastest training times at scale and highest per-accelerator performance across all tests, including new DeepSeek-V3 and GPT-OSS-20B workload…
NVIDIA researchers and collaborators published a review in the Annual Review of Biomedical Engineering detailing the transition of federated learning in healthcare from research to real-world deployme…
Amazon Web Services (AWS) has released guidance on using Amazon Nova 2 Lite for content moderation, enabling organizations to enforce custom policies through structured or free-form prompts without re…