AMD's Instinct MI450 GPU achieves 85% of peak HBM bandwidth on attention decode kernels using the Gluon kernel optimization framework, according to a technical guide published by AMD. The MI450 series…
AMD contributed a compatibility update to JAX-Triton that supports most Triton features, enabling users to run virtually any Triton or Gluon kernel inside JAX with minimal changes. The update includes…
LightSeek Org open-sourced TokenSpeed-Kernel, a portable API and high-performance kernel subsystem for multi-silicon LLM inference, decoupling runtime from hardware-specific code to simplify backend c…
NVIDIA's C++ template-based CUTLASS library for GPU kernels suffers from compile times of up to 20 seconds for a single kernel and over 17 minutes for full builds, prompting a shift toward Python-embe…