OpenAI revealed benchmark results for its first custom inference chip, Jalapeño, co-developed with Broadcom on TSMC's 3nm node, at Hot Chips 2026 on August 25. The chip delivers 1.5x–1.9x more AI work…
AMD's Instinct MI450 GPU achieves 85% of peak HBM bandwidth on attention decode kernels using the Gluon kernel optimization framework, according to a technical guide published by AMD. The MI450 series…
AMD contributed a compatibility update to JAX-Triton that supports most Triton features, enabling users to run virtually any Triton or Gluon kernel inside JAX with minimal changes. The update includes…
LightSeek Org open-sourced TokenSpeed-Kernel, a portable API and high-performance kernel subsystem for multi-silicon LLM inference, decoupling runtime from hardware-specific code to simplify backend c…
NVIDIA's C++ template-based CUTLASS library for GPU kernels suffers from compile times of up to 20 seconds for a single kernel and over 17 minutes for full builds, prompting a shift toward Python-embe…