Yandex open-sourced an 80B model trained from scratch: what's inside and where it wins
Yandex released AliceAI-Foundation-80B-A3B-Base, an 80B-parameter mixture-of-experts language model trained entirely from scratch on roughly 18T tokens and published on Hugging Face under Apache 2.0. The base model activ…