tencent/Hy3

Tencent released Hy3, a 295B-parameter Mixture-of-Experts model with 21B active parameters, outperforming similar-size models and rivaling flagship open-source models with 2-5x parameters. The model is available for free on OpenRouter until July 21st and shows significant gains across various products and productivity tasks.

Hy3 is a 295B-parameter Mixture-of-Experts MoE model with 21B active parameters and 3.8B MTP layer parameters, developed by the Tencent Hy Team. Following the Hy3 Preview launch in late April, we gathered feedback from 50+ products and scaled up post-training with higher quality data. Today, we introduce Hy3, which outperforms similar-size models and rivals flagship open-source models with 2-5x parameters. It also shows significant gains in utility across various products and productivity tasks. The full-sized model is 598GB on Hugging Face, and the FP8 quantized one is 300GB https://huggingface.co/tencent/Hy3-FP8/tree/main . The context length is 256K. It's available for free on OpenRouter until July 21st https://openrouter.ai/tencent/hy3:free . I had it "Generate an SVG of a pelican riding a bicycle" there and got this: Tags: ai https://simonwillison.net/tags/ai , generative-ai https://simonwillison.net/tags/generative-ai , llms https://simonwillison.net/tags/llms , pelican-riding-a-bicycle https://simonwillison.net/tags/pelican-riding-a-bicycle , llm-release https://simonwillison.net/tags/llm-release , ai-in-china https://simonwillison.net/tags/ai-in-china