Monarch Chrysalis: a sparse Mixture-of-Experts model that reasons in Neuralese
Monarch Chrysalis v1, a sparse mixture-of-experts model with latent-space reasoning, has completed its first training run and now runs on a consumer desktop CPU, according to its developers. The 6.93B-parameter model use…