VLLM announces efficient day-0 support for Moonshot AI's Kimi K3, a 2.8-trillion-parameter Mixture-of-Experts model, achieving up to 370 tokens per second with speculative decoding on 16 NVIDIA GB300 …
NVIDIA GB300 NVL72 set a world record for pre-training DeepSeek-V3 671B at 1,648 TFLOPs per GPU, demonstrating how advances across the AI platform—from silicon to networking to software—push training …
NVIDIA's GB300 NVL72 platform delivers up to 25x performance per watt over its predecessor, the NVIDIA Hopper, redefining AI infrastructure efficiency. The company's extreme codesign from silicon to s…
NVIDIA's Blackwell platform swept MLPerf Training 6.0, achieving the fastest training times across all seven benchmarks, scaling to 8,192 GPUs on DeepSeek-V3 671B, and delivering up to 1.6x performanc…
Artificial Analysis released AgentPerf, the first benchmark for agentic-AI infrastructure, which replays recorded multi-step agent trajectories instead of single chat completions. NVIDIA reported that…
Nvidia's new GB300 NVL72 system achieves 61,400 concurrent AI agents per megawatt, a 20x improvement over the prior-generation H200. The Blackwell Ultra rack-scale system, validated using the AgentPer…
At Computex, Delos Data demonstrated a modular server chassis designed to help AI chip startups deploy rack-scale systems more quickly. The front of the system contains 36 OSFP cages rated at 1.6 Tbps…
DeepSeek v4, an open-source model from a Chinese lab, achieved a 100x performance improvement on AMD hardware within 26 days of its Day 0 release, driven by the AMD SGLang engineering team. The Infere…
French neocloud company Mistral AI has selected VAST Data’s storage and AI Operating System stack to power its Mistral Compute GPU cloud infrastructure, providing sovereign AI facilities in Europe. Th…