14:01
2026-07-30
marcobambini.substack.com
artificial-intelligence
A new inference engine to run Kimi K3 2.78T parameter with 29GB of RAM
Marco Bambini introduces the Waste Inference Engine, a new system capable of running Kimi K3, a 2.78 trillion parameter model, using only 29GB of RAM. The engine achieves this through aggressive quant…