Apple debuted the third generation of Apple Foundation Models (AFM) on June 8, 2026, unveiling a family of five models spanning on-device and server deployments, including the 20-billion-parameter, na…
The MADSys Lab at Tsinghua University’s KTransformers project enables frontier-class MoE models like DeepSeek-R1 671B to run on commodity hardware with a CPU-GPU hybrid inference stack, achieving 286 …
Researchers at Doubleword developed UCCL-EP, an expert parallel communications kernel that enables GPU-initiated communication patterns like DeepEP to work across arbitrary NIC-accelerator pairs, incl…
Apple expanded its Private Cloud Compute (PCC) to run on Google Cloud using NVIDIA Blackwell GPUs, allowing Apple Intelligence features to process heavy AI workloads on third-party hardware while main…
NVIDIA released Nemotron 3 Ultra, a 550-billion-parameter open-weight model, on June 1, 2026, and it became available on Ollama's cloud three days later. The model uses a sparse Mixture-of-Experts des…
DeepMind released DiffusionGemma, a new large language model that uses discrete diffusion to generate entire sequences in parallel instead of autoregressive token-by-token generation. The model achiev…
NVIDIA Research and Tencent YoutuResearch have released open-source systems that replace the VAE decoder bottleneck in latent diffusion models, enabling faster 4K image generation. NVIDIA's PiD reform…
NVIDIA introduced intent-based security profiles in its Unified Fabric Manager for Quantum InfiniBand, enabling network administrators to configure multi-tenant fabric security with a single click. Th…
Google Cloud announced a collaboration with Apple to power Apple's expanded Private Cloud Compute (PCC) systems, announced at WWDC 2026, using Google Cloud's Confidential Computing portfolio and Titan…
Abridge announced a strategic investment from Eli Lilly and the launch of what it calls the first AI-native clinician intelligence platform, which documents patient-clinician conversations and uses th…
The LF AI & Data Foundation announced the formation of the DocLang Specification Working Group on June 9, 2026, to create an open, vendor-neutral specification for AI-native documents. IBM, NVIDIA, an…
Apple focused on practical AI features at WWDC 2026 rather than hyping "agentic" AI, a buzzword dominating competitor keynotes from Google, Microsoft, and NVIDIA. The company briefly mentioned agentic…
Two NVIDIA DGX Spark units were clustered over a 200 GbE link to serve the Qwen3-30B-A3B-Thinking model using Ray and vLLM with tensor parallelism. The setup required pinning all transport layers to t…
Google released DiffusionGemma, a new open-weight AI model under the Apache 2 license, available on Hugging Face. NVIDIA is hosting the model for free on its NIM cloud API, where it generated 2,409 to…
NVIDIA introduced the Halos Operating System, a safety-certified software foundation for robotaxis, at GTC Taipei, alongside new collaborations with Uber, Foxconn, VinFast, and HUMAIN to deploy autono…
Helion kernels were integrated into vLLM for FP8 inference using Qwen3 models and evaluated across NVIDIA H100 and B200 GPUs. The experiments demonstrated that Helion provides a productive PyTorch-nat…
AMD released Lemonade SDK version 10.7, adding NVIDIA CUDA support to its local AI server solution that previously only supported AMD hardware, Apple Metal GPUs, and AArch64 CPUs. The update integrate…
Google DeepMind's DiffusionGemma, optimized for NVIDIA platforms, generates text tokens in parallel rather than sequentially, achieving up to 1,000 tokens per second on a single NVIDIA H100 GPU. The m…
NVIDIA has optimized Google DeepMind's new DiffusionGemma model to run up to four times faster on its GeForce RTX GPUs, RTX PRO workstations, and DGX Spark systems. Unlike traditional language models …
Battery energy storage systems (BESS) are becoming essential infrastructure for AI factories, which require power-dense, fast-changing electrical loads that differ from traditional data centers. Prope…