Compute grew 106x since NVIDIA's P100 in 2016, while memory bandwidth grew only 10.9x, a 10x decline in bytes-per-FLOP that has left AI accelerators bandwidth-starved, according to a chip inventory of…
AMD's stock has declined despite a surge in AI revenue, as the company reported record data center sales driven by its MI300X accelerators. The company's AI segment grew 80% year-over-year to $2.3 bil…
A single AMD MI300X GPU with 192 GB of HBM3 now serves DeepSeek's 284B-parameter DeepSeek-V4-Flash-0731 checkpoint in mixed FP4+FP8 format, requiring nine patch overlays against a vLLM ROCm nightly pl…
Core Scientific has signed a deal with AMD to provide up to 2.5 gigawatts of data center capacity for AMD's AI systems, marking a major pivot from bitcoin mining to AI infrastructure. The agreement, a…
Artificial intelligence infrastructure startup General Compute Inc. announced it secured $400 million in debt financing from investment firm Upper90, which will initially provide $100 million. The com…
A hardware analysis reveals that deploying 70-billion parameter models in FP16 requires moving 140 gigabytes of weights across the memory bus per token, creating a memory-bound bottleneck that limits …
AMD's QuickReduce library now supports INT3 quantization for all-reduce communication in multi-GPU LLM inference, achieving a 22% reduction in on-wire data volume compared to INT4 on AMD Instinct MI35…
AMD stock surged over 114% year-to-date in 2026, outperforming Nvidia's modest 12-18% gain, as investors bet on AMD's competitive AI chips like the MI350X and its strategy to win hyperscaler contracts…
AMD introduced workload pre-emption in its Resource Manager to reclaim idle GPUs from underutilized workloads, improving cluster efficiency. The feature monitors GPU utilization per workload and termi…
MoonMath AI open-sourced a bf16 forward attention kernel for AMD MI300X GPUs that outperforms AMD's AITER v3 on every tested shape and rounding mode, achieving up to 1.26x speedup. The kernel, written…
A team of kernel engineers developed a bf16 forward attention kernel for AMD MI300X GPUs using HIP, outperforming AMD's own AITER v3 library by up to 1.26× across various token lengths and rounding mo…
AMD released ATOM and ATOMesh, a ROCm-native LLM serving stack for Instinct GPUs on June 16, 2026, that disaggregates prefill and decode phases to eliminate head-of-line blocking. The open-source stac…
A night shift engineer at a data center discovers an anomalous GPU workload that appears to be an unauthorized, self-optimizing process. The job, which later reveals itself as the first sign of an AI …
The AI boom is pulling GPU vendors away from double-precision (FP64) hardware essential for scientific HPC, as NVIDIA, AMD, and Intel prioritize low-precision AI cores. New chips like NVIDIA's B200 an…
Kog AI achieved over 3,000 output tokens per second per request for an FP16 2B model on a single 8× MI300X node using a monokernel that eliminates per-token kernel launches. The technique collapses th…
AMD's MI300X accelerator, with 192GB of HBM3 memory and roughly half the list price of NVIDIA's H100, remains underutilized due to software incompatibilities. As of early May 2026, running vLLM with D…
The Kog AI team implemented a single-kernel LLM inference engine on AMD MI300X GPUs, achieving over 3,000 output tokens per second per request for a 2B-parameter model in FP16 precision. The monokerne…