Xeon E5-2690 v2

A 26-billion-parameter Gemma 4 mixture-of-experts model can run at reading speed on a dual-socket 2013 Ivy Bridge Xeon server with no GPU, achieving ~5.2 tokens per second decode on a Q8_0 quant, acco…

A developer running Google's Gemma 4 26B mixture-of-experts model on a 13-year-old HP StoreVirtual server with dual Xeon E5-2690 v2 CPUs and no GPU achieved approximately 5 tokens per second inference…