Hunyuan-A13B Technical Report

Tencent released Hunyuan-A13B, an open-source large language model built on a Mixture-of-Experts architecture that carries 80 billion total parameters while activating only 13 billion during inference, according to the model's technical report. The design targets a balance of model capability, computational efficiency, and deployment cost.

We present Hunyuan-A13B, an open-source large language model based on a Mixture-of-Experts architecture. It contains 80 billion total parameters but activates only 13 billion during inference, balancing model capability, computational efficiency, and deployment cost. The model is pretrained on a rig