{"slug": "kimi-s-1-56-tb-download-lost-20-rows-to-opus", "title": "Kimi's 1.56 TB download lost 20 rows to Opus", "summary": "An audit of Moonshot's Kimi K3.1 Pro model card found that the 1.56 TB, 2.8-trillion-parameter open-weight release loses to Claude Opus 5.5 on 20 of the 39 benchmark rows where both have scores, winning 19. The reviewer verified the Hugging Face file listing, config, license and all 46 evaluation rows without downloading the model, confirming the byte arithmetic is consistent with the claimed parameter count but that the 'best open model' framing does not hold against the vendor's own numbers. Kimi wins the agent-with-tools rows and hallucination benchmarks while losing hard reasoning rows, including Program Bench at 31.5 versus Opus's 65.0.", "body_md": "Moonshot's Kimi K3.1 Pro weighs 1,561 GB across 96 files, claims 2.8 trillion parameters — and its own README table shows it losing to Claude Opus 5.5 on 20 of the 39 rows where both have scores. The download is real. The \"best open model\" framing does not survive the vendor's own numbers.\n\nI did not download 1.56 TB or run the model. What I did is audit everything that can be checked without that: the Hugging Face file listing, the config, the license, and all 46 rows of the evaluation table the model card ships. Every number below is from those sources or arithmetic on them.\n\nThe repo (moonshotai/Kimi-K3.1-Pro) was created November 2, 2026. Three days in it has 11,658 downloads and 801 likes. The file listing tells the story before any benchmark does:\n\n```\nsafetensors shards:   96\ntotal size:           1,561.29 GB\nmedian shard:         16.99 GB\nlargest shard:        16.99 GB\nsmallest shard:       0.09 GB\nmodel.safetensors.index.json: 59.77 MB\ngeneration_config.json:       53 bytes\n```\n\nNinety-five of the shards are ~17 GB each; the last is a 0.09 GB tail. The 60 MB index file is the map for 2.8 trillion parameters. The 53-byte generation config is almost empty — there is barely anything to configure at load time.\n\nThe config itself:\n\n```\ntotal parameters:     2.8T (per README)\nactivated per token:  104B (per README)\nlayers:               93 (1 dense, 92 MoE)\nexperts:              896, 16 selected per token\nattention:            69 KDA + 24 Gated DSA layers\nhidden size:          7168\ncontext length:       1,048,576 tokens\nquantization:         MXFP4 weights / MXFP8 activations, QAT\nvision encoder:       MoonViT-V2, 401M params\n```\n\nThe byte arithmetic checks out. At 4 bits per weight, 2.8 trillion parameters need 1.4 TB. The download is 1.56 TB, and the gap is explained by the config's own quantization ignore-list: attention layers, shared experts, the lm_head, and the vision tower stay unquantized, plus per-group scales. That is the honest reading — the size is consistent with the claimed parameter count, not inflated by it.\n\nOne more check on the \"3T-class\" label in the README: 2.8T rounds to 3T only with generosity. It is a 2.8T model that markets itself in the next class up. Keep that in mind for the table below.\n\nThe README ships a 46-row evaluation table against five other models: Claude Fable 5.1, GPT-6 Astra, Claude Opus 5.5, DeepSeek-V4.1-Flash, and GLM-5.3. All Kimi scores use reasoning effort `max`, temperature 1.0, top-p 0.95. I parsed every row and counted wins and losses instead of reading the headline.\n\nOn the 44 higher-is-better rows:\n\n```\nvs Claude Opus 5.5:  19 wins, 20 losses (5 rows have no Opus score)\nvs GPT-6 Astra:      22 wins, 16 losses (6 rows have no Astra score)\nbest of all 6 models: 16 of 44 rows\n```\n\nKimi loses to Opus more often than it beats it. That alone should end any \"SOTA\" claim, but the individual gaps are the real story:\n\n```\nProgram Bench:            Kimi 31.5  vs Opus 65.0   (less than half)\nHLE-Diamond:              Kimi 39.4  vs Astra 65.8\nTerminal-Bench-Science:   Kimi 38.1  vs Astra 68.1\nExploitBench:             Kimi 74.7  vs Astra 100.0\nHLE-Full:                 Kimi 51.1  vs Opus 59.8\nTerminal-Bench 4.0:       Kimi 65.7  vs Opus 66.4   (closest headline loss)\nDeepSWE v1.1:             Kimi 75.5  vs DeepSeek 77.0\n```\n\nThe wins are real too — SWE Marathon v1.1 (51.7, best of six), BrowseComp (92.1, best), HLE-Full with tools (70.0, best), Terminal-Bench 4.0 is a near-tie. The pattern is not \"Kimi is bad.\" It is \"Kimi is a strong open model that wins the agent-with-tools rows and loses the hard reasoning rows\" — which is the opposite of the launch framing. The two lower-is-better hallucination rows go Kimi's way (8.3 and 5.4, both best), so the hallucination story is the strongest part of the table.\n\nTwo more table details worth stating plainly. Eight of the 46 rows are marked Internal — Moonshot's own benchmarks, where the methodology is theirs alone. And two rows have dashes for all three closed models, so there is nothing to compare against at all: Kimi Code Bench 2.0 (77.1) and xdev-bench-hard (81.0) are Kimi-only numbers. A table where your best-looking rows are the ones nobody else was scored on is a table doing marketing work.\n\nThe LICENSE file is a custom \"Kimi K3.1-Pro License,\" not MIT or Apache. It reads like MIT for the first paragraph — use, copy, modify, distribute, sublicense, sell — then adds two gates:\n\n```\n1. If you run it as a Model-as-a-Service business and your\n   aggregate revenue exceeds $20M over any 12 months, you must\n   sign a separate agreement with Moonshot AI before ANY\n   commercial use.\n2. If your product has >100M monthly active users or >$20M in\n   monthly revenue, \"Kimi K3.1-Pro\" must be displayed\n   prominently in the UI.\n```\n\nInternal use is exempt. So is use through Moonshot's own products and certified inference partners. For everyone else, the weights are free until you are big enough to matter, and then they are not. That is a reasonable business decision and a real restriction — \"open weights\" is the accurate label, not \"open source.\"\n\nThree days after release, the facts that check out are: 96 shards, 1,561 GB, 2.8T parameters at MXFP4, 1M-token context, 11,658 downloads. The facts that do not check out are the framing: on its own table, Kimi K3.1 Pro beats Opus 5.5 on 19 rows and loses on 20, wins 16 of 44 outright, and its worst gaps are on the hardest reasoning benchmarks, not the easiest ones. If you want a 2.8T open model for agentic coding with tools, the download is justified. If you want the model that beats the frontier on reasoning, the vendor's own table says to look elsewhere — and it says so in the rows most people will not read.\n\nSources: Hugging Face repo moonshotai/Kimi-K3.1-Pro (file listing via API, November 5, 2026; config.json; README.md evaluation table; LICENSE). All counts above are my own parse of the README table; shard sizes are from the Hugging Face tree API. I did not download the weights or run the model.", "url": "https://wpnews.pro/news/kimi-s-1-56-tb-download-lost-20-rows-to-opus", "canonical_source": "https://dev.to/frankchu/kimis-156-tb-download-lost-20-rows-to-opus-3a94", "published_at": "2026-11-05 15:41:04+00:00", "updated_at": "2026-11-05 15:49:41.384921+00:00", "lang": "en", "topics": ["large-language-models", "artificial-intelligence", "ai-research"], "entities": ["Moonshot", "Kimi K3.1 Pro", "Claude Opus 5.5", "GPT-6 Astra", "DeepSeek-V4.1-Flash", "GLM-5.3", "Hugging Face", "Claude Fable 5.1"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/kimi-s-1-56-tb-download-lost-20-rows-to-opus", "markdown": "https://wpnews.pro/news/kimi-s-1-56-tb-download-lost-20-rows-to-opus.md", "text": "https://wpnews.pro/news/kimi-s-1-56-tb-download-lost-20-rows-to-opus.txt", "jsonld": "https://wpnews.pro/news/kimi-s-1-56-tb-download-lost-20-rows-to-opus.jsonld"}}