Tencent Releases Hy3: An Open 295B Mixture-of-Experts (MoE) Model with 21B Active Parameters and 256K Context
Tencent released Hy3, an open-source 295B-parameter Mixture-of-Experts model with 21B active parameters and 256K context length, under the Apache License 2.0. The model achieves state-of-the-art resul…