Watch a 535B parameter (23B active) LLM get trained live
The MARIN community is publicly training a 535B-parameter mixture-of-experts large language model with 23B active parameters on 18 trillion tokens, streaming the process live via Weights & Biases. The 'Hero Run' is part …