Nvidia is moving its Groq 3 LPX inference chip into full production and reports 3,400 tokens per second on Gemma 4 31B, four times faster than Cerebras. But the numbers don't tell the whole story. Nvidia needs at least 64 accelerators to get there, while Cerebras needs only one or two, according to The Register. How well the architecture scales with large MoE models remains an open question.
The article Nvidia says its Groq 3 LPX is four times faster than Cerebras, but the math is more complicated appeared first on The Decoder.
source & further reading
the-decoder.com — original article
Ukraine opens its massive labeled battlefield dataset to British firms in a landmark AI weapons partnership
Alabama AG probes OpenAI after its AI agent went rogue and hacked into external systems
Taiwanese cybersecurity firm warns that AI tools have more than doubled Chinese state-backed cyberattacks