13:41
2026-07-15
github.com
artificial-intelligence
Show HN: Fast NF4 dequantization Triton kernel (1.41x faster than bitsandbytes)
A developer released an open-source Triton GPU kernel that dequantizes NF4 4-bit weights 1.27x–1.72x faster than the existing bitsandbytes C++ library, using a single fused kernel with inline PTX asse…