NVIDIA introduced CUDA Rust, two new approaches that let developers write GPU kernels directly in Rust and compile them to PTX, the intermediate representation used by NVIDIA GPUs. The two tracks are …
A DeepSeek engineer who wrote the main attention kernels for DeepSeek V4.1 published a candid essay saying AI will likely match or exceed his kernel-writing and optimization ability within six months …
A new technical blog post by Iaroslav Elistratov presents a visual guide to building a B200 attention kernel from scratch in CUDA and PTX, achieving 94.4% of FlashAttention-4 performance on 4K, 8K, an…
A developer claims to have built a complete operating system, AOTX-1 (Ahead of Time eXecutive One), entirely in CUDA, with the kernel written in raw PTX. The OS includes networking (TCP/IP), graphics,…
A GitHub repository introduces an experimental Proof of Concept for an Adiabatic Silicon Aging & Thermal Degradation Failure-Fencing Engine, designed to isolate NaN and infinity propagation in hypersc…
Craton Bolt v0.7.0, a pure Rust JIT-compiled GPU SQL engine, compiles each query into a fresh NVIDIA PTX kernel at runtime via the CUDA driver API, eliminating C++ shims and precompiled kernels. The e…
Triton is a compiler with a Python frontend that parses a function's AST, runs it through an MLIR pipeline, and emits a GPU binary, never executing the Python function as Python. The compiler handles …
NVIDIA CUDA 13.3 introduces the clmad PTX instruction for carryless multiplication on all Ampere and newer GPUs, enabling hardware-accelerated cryptographic workloads. On the NVIDIA B200, GHASH throug…
A developer built Phobos, a tiny scale-free kernel language that compiles to PTX and runs on NVIDIA GPUs, achieving 76% of cuBLAS SGEMM performance on a 2080 SUPER. The language supports tile-DAG desi…
NVIDIA's CUDA kernel launch involves a multi-stage compilation pipeline from C++ to PTX virtual ISA to SASS machine code, followed by runtime coordination via ioctl system calls and doorbell register …
NVIDIA's CUDA compiler pipeline transforms a simple vector addition kernel from PTX virtual assembly to SASS machine code through multiple compilation stages, including LLVM-based cicc and ptxas, befo…