Google TPU

Google released Gemma 2, an open model family with 9B and 27B parameter sizes, featuring architectural changes like hybrid attention and Grouped-Query Attention for improved inference efficiency. The …

Researchers at UC San Diego, led by Hao Zhang, have successfully implemented a diffusion-style speculative decoding method called DFlash on Google TPUs, achieving an average 3.13x increase in tokens p…