11:57
2026-10-10
discuss.huggingface.co
machine-learning
How to improve my tokens per second?
An optimized training stack can reach roughly 51% model FLOPs utilization (MFU) on consumer GPUs, according to the LLMQ paper, leaving headroom for a user currently getting about 65 TFLOPS of useful cā¦