Baidu open-sources ERNIE 5.5 Flash Base in a race to cheap inference
Baidu published the pretraining checkpoint of ERNIE-5.5-Flash-Base on Hugging Face on November 5, a sparse mixture-of-experts model with 280 billion total parameters of which only 14 billion activate per token, released …