19:10
2026-07-23
github.com
artificial-intelligence
Frontier-class LLM inference on a laptop CPU
A new CPU-only inference runtime called cpubrrr achieves up to 5× faster token generation than llama.cpp's CPU path on frontier-class mixture-of-experts models, running on an Apple M4 Max without GPU …