Scaling Law for Quantization-Aware Training
A new unified scaling law for quantization-aware training (QAT) models quantization error as a function of model size, training data volume, and quantization group size, based on 268 experiments. The study finds that qua…