14:00
2026-08-25
dev.to
machine-learning
A Better FP4 Gradient Quantizer That Training Couldn't Notice
A developer found a scale-selection rule for NVFP4 gradient quantization that reduces mean squared error by 14% on real gradient tensors compared to the state-of-the-art MS-EDEN estimator, but traininβ¦