Marin 535B-A23B

Open Athena's Marin team has launched its largest model yet, a 535B-parameter mixture-of-experts (MoE) model with 23B active parameters, scheduled to pretrain for about 3 months on 18 trillion tokens …

Marin 535B-A23B, a 535B-parameter model with 23B active parameters, began training this week in a fully open process, according to Percy Liang's announcement on X. The run will use 18.75T tokens on 11…

Marin 535B-A23B, a 535-billion-parameter mixture-of-experts large language model with 23 billion activated parameters, began open training this week on 18.75 trillion tokens across 11 NVIDIA GB200 NVL…