10:25
2026-08-21
wandb.ai
large-language-models
Watch a 535B parameter (23B active) LLM get trained live
The MARIN community is publicly training a 535B-parameter mixture-of-experts large language model with 23B active parameters on 18 trillion tokens, streaming the process live via Weights & Biases. The…