12:30
2026-09-02
iaroslavelistratov.github.io
artificial-intelligence
B200 Attention Kernel from Scratch to Near-SOTA in 60 Diagrams
A new technical blog post by Iaroslav Elistratov presents a visual guide to building a B200 attention kernel from scratch in CUDA and PTX, achieving 94.4% of FlashAttention-4 performance on 4K, 8K, anβ¦