Gemma 4 on Amazon SageMaker: QAT Weights Decode 2.05x Faster Than bf16 on One L4
A developer benchmarked Google's Gemma 4 E2B quantization-aware trained (QAT) checkpoint against the full bf16 release on a single NVIDIA L4 SageMaker endpoint, finding the 4-bit QAT model decodes at …