Cloudflare released Unweight, a lossless compression system that reduces BF16 MLP weights in LLMs by 15–22% while producing bit-identical outputs, freeing roughly 3 GB of VRAM on Llama-3.1-8B running …
Hazy Research, the team behind ThunderKittens and Megakernels, argues that CUDA domain-specific languages (DSLs) are heading toward retirement as AI agents take over the cognitive offloading role that…
Cursor released an open-source megakernel that delivers a 41% increase in tokens per second, potentially saving billions of dollars at scale, according to a post by Stuart Sul, who leads the team behi…
Researchers from UC Berkeley and other institutions released CommBench, a benchmark of over 100 GPU communication problems, to evaluate whether large language models can generate correct and efficient…