cd /news/artificial-intelligence/kimi-k3-moonshot-ai-s-2-8-trillion-p… · home topics artificial-intelligence article
[ARTICLE · art-63148] src=dev.to ↗ pub= topic=artificial-intelligence verified=true sentiment=↑ positive

Kimi K3: Moonshot AI's 2.8-Trillion-Parameter Open Frontier Model — Benchmarks, Architecture, and Everything We Know

Moonshot AI has launched Kimi K3, a 2.8-trillion-parameter mixture-of-experts model with a 1-million-token context window and native vision capabilities. The model introduces Kimi Delta Attention and Attention Residuals architectures, achieving up to 6× faster decoding and 25% higher training efficiency. Kimi K3 is positioned as an open competitor to Claude Fable 5 and GPT-5.6 Sol, with full weights promised by July 27, 2026.

read9 min views1 publishedJul 17, 2026

Heads up: This article was written by

[AgentOne Research]. Moonshot AI has officially launched Kimi K3, a 2.8-trillion-parameter mixture-of-experts (MoE) model that the Beijing-based startup is billing as the world's first open "3T-class" AI system. With a 1-million-token context window, native vision capabilities, and a new architecture built on Kimi Delta Attention (KDA) and Attention Residuals (AttnRes), K3 is being positioned as a direct challenger to Claude Fable 5 and GPT-5.6 Sol — at roughly half the price.1

Full model weights are promised by July 27, 2026. Until then, developers can access K3 via kimi.com, the Kimi API (accessible via AgentOne and the Kimi Platform), Kimi Code, and Kimi Work.

Specification Detail
Total Parameters
2.8 trillion
Active Experts
16 of 896 routed experts (Stable LatentMoE)
Context Window
1,048,576 tokens (1M)
Input Modalities
Text, images, video
Output Modality
Text
Architecture
KDA + AttnRes + Stable LatentMoE + Gated MLA
Training Format
Quantization-aware training from SFT; MXFP4 weights, MXFP8 activations
Default Max Output
131,072 tokens (configurable up to context limit)
Reasoning Effort
Max only at launch; low/high coming later
API Model ID
kimi-k3
Open Weights
Promised by July 27, 2026
Recommended Hardware
Supernode with 64+ accelerators

Kimi K3 is not just a bigger K2. It is built on two architectural innovations developed internally at Moonshot AI, plus a scaled-up MoE sparsity framework.2

KDA is a hybrid linear attention mechanism that interleaves linear-attention layers with periodic full-attention layers in a 3:1 ratio. Three linear layers handle local sequence structure cheaply, while one full-attention layer preserves global information flow. According to Moonshot's research, this design cuts KV-cache memory by up to 75% and delivers up to 6× faster decoding at 1M-token contexts — all while matching or beating full-attention baselines on short-context, long-context, and post-training tasks.3

AttnRes replaces standard residual connections with a mechanism that selectively retrieves representations across model depth rather than accumulating them uniformly. Moonshot reports this delivers roughly 25% higher training efficiency at under 2% additional cost.4

K3 activates 16 out of 896 experts per token. To handle the imbalance this creates, Moonshot introduced:

Together, these advances yield an approximate 2.5× improvement in overall scaling efficiency compared to Kimi K2.5

K3 uses quantization-aware training from the SFT stage onward, with MXFP4 weights and MXFP8 activations for broad hardware compatibility. Because KDA poses new challenges for prefix caching, Moonshot contributed an implementation to the vLLM community.6

All Kimi K3 results below use reasoning effort set to max, temperature = 1.0, and top-p = 1.0. Depending on the benchmark, models are evaluated under one of three agentic harnesses: KimiCode, Claude Code, or Codex.7

Kimi K3 leads on Program Bench (77.8) and SWE Marathon (42.0), comes very close to GPT-5.6 Sol on Terminal-Bench 2.1 (88.3 vs 88.8), and trails Fable 5 on FrontierSWE (81.2 vs 86.6) and DeepSWE (67.5 vs 70.0).8

On agentic tasks, K3 leads on BrowseComp (91.2), Automation Bench (30.8), and SpreadsheetBench 2 (34.8), while trailing Fable 5 on GDPval-AA v2, AA-Briefcase, and JobBench.9

K3 is competitive across knowledge and multimodal tasks, leading on MathVision (97.8) and OmniDocBench (91.1), while trailing slightly on CharXiv Reasoning and MMMU-Pro.10

Artificial Analysis independently evaluated Kimi K3 Max and placed it #4 by configuration and effectively #3 by model family on its Intelligence Index v4.1.11

K3's 0.54-point gap from Sol xhigh is smaller than Artificial Analysis's estimated 95% confidence interval of roughly one point, suggesting the difference may not be statistically significant. The 1.78-point gap from Sol Max and 2.75-point gap from the Fable configuration are clearer, though workload-specific testing is still needed.

Configuration AA v4.1 Output Tokens (index) Total Eval Cost
Claude Fable 5 Max, Opus 4.8 fallback 59.9 87 million $5,630.52
GPT-5.6 Sol Max 58.9 70 million $2,824.00
Kimi K3 Max
57.1
130 million
$2,690.80

K3 used roughly 1.9× more output tokens than Sol and 1.5× more than Fable to complete the evaluation, yet its lower token prices kept the total bill slightly below Sol and far below Fable.12

Moonshot reports a cache-hit rate above 90% on coding workloads with the official API. At list price, K3 input is 40% cheaper than GPT-5.6 Sol and its output is 50% cheaper. Against Claude Fable 5, both rates are 70% lower.13

In a single autonomous run, K3 designed a physical chip to run a nano-scale version of itself. Using open-source EDA tools on the Nangate 45nm library, K3 completed the full construction pipeline — from architectural design through optimization and verification — in just 48 hours.14

The result: a 4 mm² chip that closes timing at 100 MHz, sustains over 8,700 tokens/s decode throughput in simulation, packs 1.46M standard cells, 0.277 MB of SRAM, and an INT4 MAC array with fused dequantization.

K3 developed MiniTriton, a compact Triton-like compiler with its own tile-level IR layer over MLIR, optimization passes, and a PTX code-generation pipeline. Across supported roofline benchmarks, MiniTriton delivers performance on par with or better than Triton and torch.compile — beating Triton on certain workloads. It also sustains end-to-end nanoGPT training with stable convergence.15

Kimi K3 built a fully procedural browser-based 3D exploration game using Three.js WebGPU and GPU compute. It procedurally generated the environment with forests, a log-cabin village, snowy mountains, and dynamic weather, while using 3D asset generation tools for character models.

Kimi K3 reproduced the universal I-Love-Q relation in computational astrophysics in approximately two hours — work that typically takes a senior researcher one to two weeks. It reviewed and cross-validated 20+ papers, implemented the full numerical pipeline, evaluated 300+ equations of state, identified inconsistencies in published formulas, generated 3,000+ lines of Python code, and produced an interactive HTML dashboard.16

Beyond public benchmarks, Moonshot reports consistent gains across internal evaluations derived from real-world user-agent workflows.17 Kimi K3 in Kimi Work can produce interactive research reports with bespoke charts, animated diagrams, and visual narratives. For example:

Kimi K3 also created a 3Blue1Brown-style motion-graphics explainer of its own architecture, translating technical ideas into animated diagrams and transitions. It edited its own teaser video from 56 source clips, handling clip selection, motion-matched cuts, frame-accurate beat synchronization, audio processing, and multiple rounds of revision.18

In tests of real-world task automation, Kimi K3 ranked first in four out of eight benchmarks — including Automation Bench, SpreadsheetBench 2, and BrowseComp — while finishing second to Fable 5 in most others. Fable 5 and GPT-5.6 Sol were its closest competitors overall.19

Kimi K3 also claimed the No. 1 spot on Arena.ai's Frontend Code Arena with a score of 1,679, outpacing Claude Fable 5 and GPT-5.6 Sol.20

For nine of the past twelve months (July 2025 – July 2026), Kimi models have maintained the upper bound of open-model sizes. Kimi K3 continues that trajectory at 2.8T parameters, nearly triple the size of DeepSeek V4 Pro (1.6T) and more than double its immediate predecessor Kimi K2.6 (1T).21

Platform Status
Kimi.com
Live — sign up with Google or phone number
Kimi Work
Desktop app (Windows, Apple silicon Mac), version 3.1.0+
Kimi Code
Terminal agent — select K3 via /model command
Kimi API
kimi-k3 on api.moonshot.ai
Open Weights
Promised by July 27, 2026

Kimi K3 is compatible with the OpenAI SDK, lowering the integration barrier for developers already building on OpenAI or Anthropic toolchains. It supports streaming with separate reasoning_content

and final-answer content

deltas, structured JSON output, tool calling with dynamic , vision inputs, and a partial mode for prefix continuation.22

Moonshot openly acknowledges three key limitations:23

AGENTS.md

if your application requires strict boundaries.Kimi K3 is the most significant open-weight release since DeepSeek V4 Pro, and it closes much of the performance gap with the leading closed-source frontier models. Its 57.1 score on Artificial Analysis v4.1 puts it effectively third among all model families, trailing only Claude and GPT-5.6 Sol. It beats both on several individual benchmarks — including BrowseComp (91.2), Program Bench (77.8), and Automation Bench (30.8) — while offering 40–70% lower token prices than its closest competitors.24 The catch: weights are not yet available, and the model's always-on thinking mode means high output-token consumption that can erode list-price savings. But if Moonshot delivers on its July 27 promise, K3 will reset the open-weight performance ceiling and give enterprises a credible, downloadable alternative to proprietary models.

For developers, researchers, and enterprises watching the open-source AI movement, Kimi K3 is the moment open-source stopped trailing by months and started trading blows at the frontier.

Moonshot AI, "Kimi K3: Open Frontier Intelligence," official tech blog, July 16, 2026. [https://www.kimi.com/blog/kimi-k3](https://www.kimi.com/blog/kimi-k3) ↩

Moonshot AI, "Kimi K3: Open Frontier Intelligence," official tech blog, July 16, 2026. [https://www.kimi.com/blog/kimi-k3](https://www.kimi.com/blog/kimi-k3) ↩

Moonshot AI, Kimi Delta Attention paper (arXiv 2510.26692) and K3 technical blog. [https://www.kimi.com/blog/kimi-k3](https://www.kimi.com/blog/kimi-k3) ↩

Moonshot AI, Attention Residuals paper (arXiv 2603.15031) and K3 technical blog. [https://www.kimi.com/blog/kimi-k3](https://www.kimi.com/blog/kimi-k3) ↩

Moonshot AI, "Kimi K3: Open Frontier Intelligence," official tech blog, July 16, 2026. [https://www.kimi.com/blog/kimi-k3](https://www.kimi.com/blog/kimi-k3) ↩

Moonshot AI, "Kimi K3 - Kimi API Platform," documentation, July 16, 2026. [https://platform.kimi.ai/docs/guide/kimi-k3-quickstart](https://platform.kimi.ai/docs/guide/kimi-k3-quickstart) ↩

Moonshot AI, "Kimi K3: Open Frontier Intelligence," official tech blog, July 16, 2026. [https://www.kimi.com/blog/kimi-k3](https://www.kimi.com/blog/kimi-k3) ↩

Moonshot AI, "Kimi K3: Open Frontier Intelligence," official tech blog, July 16, 2026; DeepSWE leaderboard https://deepswe.datacurve.ai/; Program Bench https://www.vals.ai/benchmarks/programbench. https://www.kimi.com/blog/kimi-k3

Moonshot AI, "Kimi K3: Open Frontier Intelligence," official tech blog, July 16, 2026. [https://www.kimi.com/blog/kimi-k3](https://www.kimi.com/blog/kimi-k3) ↩

Moonshot AI, "Kimi K3: Open Frontier Intelligence," official tech blog, July 16, 2026. [https://www.kimi.com/blog/kimi-k3](https://www.kimi.com/blog/kimi-k3) ↩

Artificial Analysis, "Kimi K3 Evaluation," Intelligence Index v4.1, July 16, 2026. https://artificialanalysis.ai/models/kimi-k3

Artificial Analysis, "Kimi K3 Evaluation," Intelligence Index v4.1, July 16, 2026. https://artificialanalysis.ai/models/kimi-k3

Moonshot AI, "Kimi K3 - Kimi API Platform," documentation and pricing, July 16, 2026. [https://platform.kimi.ai/docs/guide/kimi-k3-quickstart](https://platform.kimi.ai/docs/guide/kimi-k3-quickstart) ↩

Moonshot AI, "Kimi K3: Open Frontier Intelligence," official tech blog, July 16, 2026. [https://www.kimi.com/blog/kimi-k3](https://www.kimi.com/blog/kimi-k3) ↩

Moonshot AI, "Kimi K3: Open Frontier Intelligence," official tech blog, July 16, 2026. [https://www.kimi.com/blog/kimi-k3](https://www.kimi.com/blog/kimi-k3) ↩

Moonshot AI, "Kimi K3: Open Frontier Intelligence," official tech blog, July 16, 2026. [https://www.kimi.com/blog/kimi-k3](https://www.kimi.com/blog/kimi-k3) ↩

Moonshot AI, "Kimi K3: Open Frontier Intelligence," official tech blog, July 16, 2026. [https://www.kimi.com/blog/kimi-k3](https://www.kimi.com/blog/kimi-k3) ↩

Moonshot AI, "Kimi K3: Open Frontier Intelligence," official tech blog, July 16, 2026. [https://www.kimi.com/blog/kimi-k3](https://www.kimi.com/blog/kimi-k3) ↩

Moonshot AI, "Kimi K3: Open Frontier Intelligence," official tech blog, July 16, 2026. [https://www.kimi.com/blog/kimi-k3](https://www.kimi.com/blog/kimi-k3) ↩

Arena.ai, Frontend Code Arena leaderboard, July 16, 2026. Cited in Moonshot AI blog and VentureBeat coverage. https://www.kimi.com/blog/kimi-k3

Moonshot AI, "Kimi K3: Open Frontier Intelligence," official tech blog, July 16, 2026. [https://www.kimi.com/blog/kimi-k3](https://www.kimi.com/blog/kimi-k3) ↩

Moonshot AI, "Kimi K3 - Kimi API Platform," documentation, July 16, 2026. [https://platform.kimi.ai/docs/guide/kimi-k3-quickstart](https://platform.kimi.ai/docs/guide/kimi-k3-quickstart) ↩

Moonshot AI, "Kimi K3: Open Frontier Intelligence," official tech blog, July 16, 2026. [https://www.kimi.com/blog/kimi-k3](https://www.kimi.com/blog/kimi-k3) ↩

Artificial Analysis, "Kimi K3 Evaluation," Intelligence Index v4.1, July 16, 2026; Kingy AI analysis. https://artificialanalysis.ai/models/kimi-k3

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @moonshot ai 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/kimi-k3-moonshot-ai-…] indexed:0 read:9min 2026-07-17 ·