NVIDIA researchers introduced Nonuniform Tensor Parallelism (NTP), a framework that dynamically adjusts tensor parallelism to maintain high Goodput during large-scale LLM training despite GPU interrup…
NVIDIA announced that its Confidential Computing technology for Blackwell GPUs achieves up to 98% of the inference performance of non-secure solutions, enabling hardware-rooted AI security without sig…
NVIDIA announced multi-device inference support in TensorRT 11.0, enabling native high-performance multi-GPU inference for generative AI workloads. The feature integrates with NCCL for distributed col…
Enterprise leaders are realizing that AI efficiency depends not only on model optimization but also on co-design of hardware, compilers, runtime, and cloud architecture. Inefficient AI can cost billio…
Microsoft announced a broad set of enhancements to Azure Kubernetes Service at Build 2026, including bare metal support, fleet management, and AI infrastructure features, aiming to make Kubernetes a f…
Frontier LLMs including GPT-5.5, Gemini 3 Pro, and Opus 4.7 failed to correctly solve over two-thirds of problems in ParallelKernelBench, a new benchmark for multi-GPU kernel generation. The benchmark…
NVIDIA swept MLPerf Training v6.0 benchmarks, achieving the fastest training times at scale and highest per-accelerator performance across all tests, including new DeepSeek-V3 and GPT-OSS-20B workload…
NVIDIA's Blackwell platform swept MLPerf Training 6.0, achieving the fastest training times across all seven benchmarks, scaling to 8,192 GPUs on DeepSeek-V3 671B, and delivering up to 1.6x performanc…
A developer found that 4 to 8 dedicated GPUs, such as the H200 NVLink, are sufficient for most production inference workloads on 70B to 200B parameter models, debunking the need for multi-node cluster…
Taiwan's Zhen Ding Technology has joined Nvidia's MGX ecosystem to supply cable-free PCB-based interconnect technology that replaces hundreds of individual copper cables in AI server racks. The approa…
Researchers from UC Berkeley's UCCL project released mKernel, a library of persistent CUDA kernels that fuse intra-node NVLink communication, inter-node RDMA, and compute into a single kernel to addre…
NVIDIA released Nemotron-Labs Diffusion on May 23, 2026, a family of diffusion language models (DLMs) that generate entire blocks of tokens in parallel and iteratively refine them, rather than produci…
NVIDIA and SchedMD have released a new topology/block plugin for Slurm 23.11 that enables topology-aware job scheduling on NVIDIA GB200 NVL72 systems, allowing workloads to be aligned with NVLink doma…
Intel's data center CPU sales surged as AI inference demand shifted system designs from 8-to-1 GPU-to-CPU ratios to 4-to-1 or even 2-to-1 configurations, increasing CPU content per AI system. Intel CF…
Nvidia's Blackwell B200 GPU is the company's first chiplet design, using two reticle-sized dies that appear as a single GPU to software, moving away from the monolithic approach used in prior generati…