Getting GLM 5.2 running on my slow computer
A developer successfully ran GLM 5.2, a 744B-parameter Mixture-of-Experts model, on a laptop with 32GB RAM by streaming routed experts from disk. The project, called Colibrì, is a single C file engine that activates only…