Kimi K3 Is the Biggest Open-Weight Model Ever Shipped. Here's What Actually Matters.

Moonshot AI released Kimi K3, a 2.8-trillion-parameter open-weight model, on July 27, making it the largest open-weight model ever shipped. The mixture-of-experts model tops benchmarks like Frontend Code Arena and GPQA Diamond, outperforming closed models, though developer Simon Willison noted high reasoning token overhead in a test.

On July 16, Moonshot AI — the Alibaba-backed startup behind Kimi — put Kimi K3 behind an API. Today, July 27, the full weights land on Hugging Face. No waitlist, no "responsible scaling" essay, no six-month delay between "we built something scary" and "here, run it yourself." Just 2.8 trillion parameters, open, on the day they said it would happen. That's not a small model with a big number attached. It's the largest open-weight model ever released, full stop. And unlike most "open" releases that quietly underperform their closed competitors, K3 is winning on the benchmarks developers actually care about. Let's get into what's real and what's marketing. K3 is a mixture-of-experts model: 2.8T total parameters, but it only activates 16 of 896 experts per token. That's the trick that makes a model this size runnable at all — you're not paying compute for the full 2.8T on every forward pass. The architecture story is Kimi Delta Attention KDA , a hybrid linear attention mechanism Moonshot claims delivers 6.3x faster decoding, plus "attention residuals" that improve token efficiency by 25% for roughly 2% extra compute. Whether that holds up under independent scrutiny is still TBD, but the direction — make huge models cheap to serve — is the correct one, and it shows up in the token counts: K3 uses 21% fewer output tokens than its predecessor, K2.6, for comparable tasks. Context window: 1,048,576 tokens. Flat pricing, no context-length tiering — a real advantage over providers who quietly double your rate past 128K. Benchmarks that matter: | Benchmark | K3 | Comparison | |---|---|---| | Frontend Code Arena | 1679 Elo 1 | Claude Fable 5: 1631, GPT-5.6 Sol: 1618 | | GPQA Diamond | 93.5% | Best open-weight score ever published | | GDPval-AA v2 | 1687 3 | Behind Claude Fable 5 Max 1815 , GPT-5.6 Sol Max 1747.8 — ahead of Claude Opus 4.8 1600 | | Artificial Analysis Elo | 1547 | +732 over K2.6 | Read that middle row again: an open-weight model is 1 on an independent frontend coding arena, ahead of the current flagship closed models. That's not "competitive for open source." That's just competitive. Flat across the full 1M context. Compare that to what you're paying for frontier closed models with similar context windows, and the math gets uncomfortable fast for anyone building high-volume agentic pipelines — the workload where you're burning huge amounts of input tokens re-sending context on every turn. Simon Willison ran his standard "draw a pelican riding a bicycle" SVG test against K3, and it's worth paying attention to what he found, because it cuts against the hype: the pelican cost 25 cents — 95 input tokens turned into 16,658 output tokens, with over 13,000 of those burned on reasoning tokens before the model produced any SVG. That's the tell. A model that spends 79% of its output budget "thinking" about drawing a bird is a model where the efficiency claims and the actual token bill don't fully agree with each other. Willison's take, and I'd sign off on it: the pelican benchmark itself has stopped being predictive of real capability — models have started overfitting to benchmark-shaped tasks — but it's still a decent smoke test for whether a model's cost structure matches its marketing. K3's doesn't, quite. The practical implication: budget for reasoning token overhead on anything agentic. The sticker price per million tokens looks great until your model decides every task needs 15,000 tokens of internal monologue first. K3 speaks the OpenAI-compatible API shape, so if you're already on the OpenAI SDK, swapping the base URL gets you running in about thirty seconds: python from openai import OpenAI client = OpenAI api key="YOUR MOONSHOT KEY", base url="https://api.moonshot.ai/v1", response = client.chat.completions.create model="kimi-k3", messages= {"role": "user", "content": "Refactor this function for readability, then explain your reasoning in three bullets."} , print response.choices 0 .message.content It's also live on OpenRouter moonshotai/kimi-k3 if you don't want to manage a separate API key, though at launch expect 429s — upstream capacity is reportedly tight in the first days after a release this size. If you're running agentic coding workflows and you're price-sensitive, yes — pilot it. The Frontend Code Arena win isn't a fluke of one narrow benchmark; it's backed up by leading scores on SWE Marathon and Program Bench too, which are harder to game than a single leaderboard. If you're running latency-sensitive, low-reasoning-budget tasks — chat, classification, simple extraction — the pelican result is your warning sign. Test your actual token spend before you commit, not just the headline per-million rate. Either way: the fact that a 2.8T open-weight model can even show up in this conversation, on release day, with full weights, is the real story here. Six months ago "open-weight" meant "smaller and worse." That gap just closed in public, on a Sunday, with a Hugging Face link instead of a press conference.