Moonshot AI's Kimi K3 model scales to 2.8T total parameters with 104B activated per token, using hybrid attention, Attention Residuals, and Stable LatentMoE to support 1M-token agentic trajectories. T…
Moonshot AI released Kimi K3, a 2.8-trillion-parameter open-weights model, the largest open-weight model ever released and the first open-source model in the 3-trillion-parameter class, designed for l…
Together AI announced a strategic partnership with Moonshot AI to become the launch platform for Moonshot's open-weight models, starting with Kimi K3, a 2.8 trillion parameter sparse Mixture-of-Expert…
Moonshot AI's Kimi K3, a flagship model with 2.8 trillion parameters and a 1M-token context window, is now live on Canopy Wave. The model, built on Kimi Delta Attention (KDA) and Attention Residuals, …
Moonshotai released Kimi-K3, a 2.8 trillion parameter open-weight multimodal agentic model on Huggingface, claiming it is the world's first open 3T-class model. It features a 1-million-token context w…
Moonshot AI released Kimi K3, a 2.8T-parameter open-weight multimodal agentic model, on Ollama with Pro or Max subscription and extra usage credits. The model features Kimi Delta Attention and Attenti…
Moonshot AI released the model weights and technical report for Kimi K3, a 2.8-trillion-parameter Mixture-of-Experts model with native visual understanding and a 1-million-token context window, along …
Moonshot AI released Kimi K3, an open-weight 2.8-trillion-parameter native multimodal agentic model with a 1-million-token context window, claiming it is the world's first open 3T-class model. Built o…
Researchers propose Dual Attention Residuals (DAR), a method that brings multi-stream interaction into historical retrieval for Transformer models through reciprocal cross-stream addressing. Across de…
Chinese AI lab Moonshot AI launched the 2.8 trillion-parameter Kimi K3 open weights model on Thursday, with benchmark data showing it trails Anthropic and OpenAI's leading models by just one generatio…
Moonshot AI has launched Kimi K3, a 2.8-trillion-parameter mixture-of-experts model with a 1-million-token context window and native vision capabilities. The Beijing-based startup claims it challenges…