**Google shipped an update to its open AI model Gemma 4 that speeds up performance on Nvidia Hopper GPUs, fixes tool calling bugs, and addresses problems with truncated responses. **Turning on Flash Attention 4 boosts the speed at which the model processes incoming prompts by 25 to 70 percent, according to Google. Time to first token drops by up to 31 percent. Google also fixed bugs in tool calling, the feature that lets the model trigger external tools on its own.
Google says it also cut down on cases where the model would cut answers short or return incomplete responses. For image processing, users can manually raise the "max_soft_tokens" parameter from 280 to 1,120 to get sharper OCR results and support resolutions up to 2.51 megapixels. Google put up an interactive configurator on Hugging Face for that. The published benchmarks only compare the 31B and E4B variants against their predecessors, but the Hugging Face repository shows that all parameter sizes in this model generation got updated, including the newest 12B release. The community has pushed back on Google shipping the update under the same "Gemma 4" name instead of tagging it as a separate version like "Gemma 4.1."
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
Subscribe now