Can a QAT 12B Fit an 8 GB GPU? Gemma 4 12B on an RTX 3050
A developer rebuilt Google's QAT Gemma 4 12B GGUF so that every weight, including the embedding table Google ships at 6 bits, sits on the 4-bit grid QAT trained, shrinking the file from 6.98 GB to 6.7…