ByteDance Seed and Tsinghua AIR released CUDA Agent, an agentic reinforcement learning system that trains a large language model to generate CUDA kernels outperforming a compiler. On KernelBench, the …
PyTorch's torch._assert_async API enables asynchronous assertion on GPU device streams, avoiding graph breaks in torch.compile. The API accepts a boolean tensor and reports failures only when the GPU …
A developer's optimization campaign on an RTX 3080 Ti cut a GPT-2-small-class transformer's forward pass from 78.2ms to 1.60ms, a 49× speedup, beating torch.compile's 1.72ms and reaching 136,000 token…
JAX, a numerical computing library, is fundamentally a tracing machine that converts pure Python functions into a typed intermediate representation called a jaxpr, refusing to execute code with contro…
Slow single-image diffusion model inference is primarily caused by kernel launch overhead and attention memory traffic, not by a lack of computational power. It recommends using `torch.compile` with `…