Demystifying Integer Quantization for Neural Network Inference
Integer quantization reduces neural network memory and energy costs by converting high-precision values to lower-bit integers, with INT8 additions consuming 30 times less energy than FP32. The technique leverages hardwar…