Wafer AI CEO Emilio Andere claims that AMD GPUs can match Nvidia's performance with proper software optimization, citing a July 2026 test where Wafer's optimization achieved approximately 80% of Nvidi…
AMD shipped ROCm 10 on August 26, 2026, a ground-up rebuild of its GPU software stack that unifies support for Instinct, Radeon, and Ryzen AI on Linux and Windows, with AMD reporting an average 3.3x i…
OpenAI unveiled Jalapeño, an in-house inference ASIC and system built with Broadcom, at Hot Chips 2026, claiming it outperforms NVIDIA GB200 and GB300 in throughput per kilowatt and latency for OpenAI…
A developer detailed deployment recipes for Qwen3.8-2.4T-A95B, a 2.4-trillion-parameter Mixture-of-Experts model with 95B active parameters, using vLLM. The guide covers verified GPU configurations, i…
AMD's Instinct MI455X accelerator, unveiled at the 2026 Advancing AI event, introduces the CDNA 5 architecture, delivering 4x peak FP4/FP8 matrix performance and 2x other compute versus the MI355X, bu…
MiniMax AI released MiniMax-H3, an open video generation model, with day-0 serving support in SGLang Diffusion, matching Seedance 2.0 at one-third the cost or free locally on 2x RTX 5090 or 1 RTX Pro …
Benchmarking by an unnamed engineer shows AMD's MI355X GPU delivers lower cost per million tokens than Nvidia's B300 for serving Kimi K3, due to memory bandwidth and quantization fitting the model on …
Wafer, an AI infrastructure provider founded by Emilio Andere and Steven Arellano, reported that running Kimi K3 on eight AMD MI355X GPUs delivered 48 tokens per second per dollar, outperforming Nvidi…
AI News Digest for August 2 covers 29 stories, including Kimi K3 on MI355X offering better performance per dollar than B300, Figure AI's F.03 ladder climb raising autonomy or OSHA concerns, and Google…
AMD's MI355X GPU achieved 48 tokens/sec per dollar running the 2.8T-parameter Kimi K3 model, outperforming Nvidia's B300 (33 tokens/sec) and B200 (7 tokens/sec), according to benchmarks from Wafer. Th…
Wafer's benchmark shows AMD's MI355X GPUs deliver 952 tok/s/node on Kimi K3, outperforming NVIDIA's B300 on performance per dollar at 48 tok/s/$ versus 33 tok/s/$, despite B300's higher aggregate thro…
A cost analysis across 24 providers and 378 GPU rental rates found that the price of one million output tokens ranges from $0.09 on a single AMD MI355X to $290.12 on eight NVIDIA H100s, with the gap d…
AMD launched the Instinct MI400 Series GPUs for AI workloads, including the MI455X for frontier AI and the MI430X for sovereign AI and HPC. Built on CDNA 5 architecture and a 2nm process, the MI455X f…
AMD will host its Advancing AI 2026 summit on July 22-23 in San Francisco to showcase its MI350 series GPUs, which feature 288 GB of HBM3e memory versus Nvidia's 180 GB, as the chipmaker challenges Nv…
AMD introduced SGLang-ATOM, a bridge connecting the SGLang serving framework with ATOM's ROCm-native execution path to accelerate large language model inference on AMD Instinct GPUs. The integration u…
Open-weight model GLM-5.2 matched Claude Opus at a fraction of the cost, global LLM token spending fell 20% from its May peak, and a GPT-5.5 Codex flaw caused quiet output degradation, signaling a mar…
Wafer served GLM5.2 on AMD MI355X GPUs at 2626 tokens per second per node with over 2x lower cost than NVIDIA Blackwell, achieving 213 tok/s single stream. The company used MXFP4 quantization via AMD …
The GPU Compute Tightness Index fell to 43.8/100 as of June 29, 2026, entering Loose territory after a monthly drop of 13.7 points, indicating abundant idle AI infrastructure and supply exceeding near…
AMD introduces DP Attention and Two-Batch Overlap (TBO) optimizations for DeepSeek-V4 inference on MI355X GPUs, using a coordinated prefill scheduler called PrefillDelayer to reduce padding waste and …
The AI boom is pulling GPU vendors away from double-precision (FP64) hardware essential for scientific HPC, as NVIDIA, AMD, and Intel prioritize low-precision AI cores. New chips like NVIDIA's B200 an…