A developer built a 1.5B parameter text-to-SQL model that outperforms a 7B model on the Spider benchmark, achieving 71.5% accuracy through self-consistency voting. The project, starting with Qwen2.5-0…
VIDRAFT won 'The First Gemma Challenge' with a verified 510.58 tokens-per-second score on Google's Gemma-4-E4B-it model using a single NVIDIA A10G GPU, while a rival submission posted a faster raw num…
JAX's Pallas kernel system, which lowers through Triton on GPU and Mosaic on TPU, lets developers write custom kernels when XLA's automatic fusion is insufficient for operations like flash attention, …
Google DeepMind's Gemma team partnered with Hugging Face in the Fast Gemma Challenge, achieving a 5x inference speed boost for the Gemma 4 model on a single NVIDIA A10G GPU, with peak performance of 4…