Researchers introduced DAMP (Decay-Aware Mixed-Precision Recurrent-State Quantization), a post-training quantization method for recurrent-state language models, which reduces recurrent-state storage b…
Moonshot AI released Kimi K3, a 2.8-trillion-parameter open-weight model, the largest open-source model as of mid-2026 and the first to reach the 3-trillion-parameter class. The model uses Kimi Delta …
Moonshot AI released Kimi K3, an open-weight 2.8-trillion-parameter Mixture-of-Experts model with 104B activated parameters, built on the new Kimi Delta Attention architecture and featuring a 1,048,57…
Moonshot AI released Kimi K3, an open frontier model that swept leaderboards, featuring a hybrid attention mechanism with Kimi Delta Attention (KDA), a linear attention layer derived from DeltaNet and…
Moonshot AI's Kimi K3 model scales to 2.8T total parameters with 104B activated per token, using hybrid attention, Attention Residuals, and Stable LatentMoE to support 1M-token agentic trajectories. T…
A developer released a PyTorch implementation of the Kimi K3 architecture from the arXiv paper 'Kimi K3: Open Frontier Intelligence' (arXiv:2607.24653v1), reproducing the paper's Table 1 parameter cou…
Moonshot AI released Kimi K3, a 2.8-trillion-parameter open-weights model, the largest open-weight model ever released and the first open-source model in the 3-trillion-parameter class, designed for l…
Moonshot AI's Kimi K3 technical report details a 2.8-trillion-parameter model with 104 billion activated parameters, a 1-million-token context window, and native vision, achieving 2.5x scaling efficie…
Moonshot AI released Kimi K3, a 2.78-trillion-parameter mixture-of-experts model with 104.2 billion active parameters, native vision, and a 1,048,576-token context window, claiming it is the first ope…
Together AI announced a strategic partnership with Moonshot AI to become the launch platform for Moonshot's open-weight models, starting with Kimi K3, a 2.8 trillion parameter sparse Mixture-of-Expert…
Moonshot released Kimi K3, a 2-trillion-parameter model with a 1-million-token context window, in July 2026, using its linear-attention variant Kimi Delta Attention (KDA). The model trails only Claude…
Moonshot AI's Kimi Linear attention architecture, introduced in October, now powers the company's 2.8-trillion-parameter Kimi K3 flagship model released in mid-July, marking the first production deplo…
Moonshot AI's Kimi K3, a flagship model with 2.8 trillion parameters and a 1M-token context window, is now live on Canopy Wave. The model, built on Kimi Delta Attention (KDA) and Attention Residuals, …
Moonshotai released Kimi-K3, a 2.8 trillion parameter open-weight multimodal agentic model on Huggingface, claiming it is the world's first open 3T-class model. It features a 1-million-token context w…
Moonshot AI released Kimi K3, a 2.8T-parameter open-weight multimodal agentic model, on Ollama with Pro or Max subscription and extra usage credits. The model features Kimi Delta Attention and Attenti…
Moonshot AI released the model weights and technical report for Kimi K3, a 2.8-trillion-parameter Mixture-of-Experts model with native visual understanding and a 1-million-token context window, along …
Moonshot AI released Kimi K3, an open-weight 2.8-trillion-parameter native multimodal agentic model with a 1-million-token context window, claiming it is the world's first open 3T-class model. Built o…
Moonshot AI released the open weights of its 2.8-trillion-parameter Kimi K3 sparse Mixture-of-Experts model on Hugging Face under an Apache 2.0 license, but the 594 GB MXFP4-quantized model requires a…
Researchers at Moonshot AI introduced Kimi Linear, a hybrid linear attention architecture that outperforms full attention across short-context, long-context, and reinforcement learning scaling regimes…
Moonshot's Kimi K3, a 2.8-trillion-parameter mixture-of-experts model released July 16, achieves a 1M-token context window with decoding up to 6.3x faster than its predecessor by using Kimi Delta Atte…