11:00
2026-07-31
portfolio-orcin-beta-29.vercel.app
artificial-intelligence
Tokens per Second Is a Memory Bandwidth Number
Tokens per second for local LLM generation is primarily a memory bandwidth number, not a measure of silicon cleverness, according to an analysis by an unnamed author. At batch size one, generation spe…