{"slug": "kimi-k3-1-pro-on-iac-bench-2026-10", "title": "Kimi K3.1 Pro on iac-bench 2026-10", "summary": "Moonshot AI's Kimi K3.1 Pro scored an overall composite of 86.5 (95% CI 84.8–88.7) on the iac-bench 2026-10 infrastructure-as-code benchmark, ranking sixth of 16 models and the highest open-weight model in the field, according to the benchmark's published results. Kimi K3.1 Pro ranked third on the mechanical score alone (85.6, behind Claude Fable 5.2 and Claude Opus 5.5) and ninth on the judge score (88.6), with all 9 attempts planning successfully, zero failed gates and zero security findings, at an estimated total cost of $3.52. The model's strongest fixture was S3 (G001), where it tied fourth by median composite at 85.6, while App Service (G003) had its highest median (87.8) but placed eighth and Cloud SQL (G002) placed seventh (86.0, up from 79.2 for Kimi K3).", "body_md": "New: LLM Rankings are live!\n\n[See how the top LLMs rank on real infrastructure tasks](https://www.massdriver.cloud/llm-rankings)\n\nHow Kimi K3.1 Pro did on iac-bench 2026-10: an overall composite of 86.5, scores per fixture, strengths, weaknesses and the patterns in its OpenTofu modules.\n\nEvery model evaluated on the 2026-10 fixtures side by side, with a sortable leaderboard, picks by use case and the cost of each: [LLM rankings](https://www.massdriver.cloud/llm-rankings).\n\n| Developer | Moonshot AI | \n| API identifier | `moonshotai/kimi-k3.1-pro` | \n| Access | OpenRouter, pinned to Moonshot AI's endpoint (MXFP4) | \n| Weights | Open | \n| List price (USD / M tokens, in / out) | 2.00 / 10.00 (OpenRouter, 2026-11-10) | \n| Evaluated | 2026-11-10 (generation and judge) | \n| Attempts | 9 (3 fixtures × 3 samples) | \n| **Overall composite** | **86.5** (95% CI 84.8–88.7) | \n| Rank | 6 of 16 (95% rank interval 3–9) | \n| Mechanical only / judge only | 85.6 (rank 3) / 88.6 (rank 9) | \n| Failed gates · insecure attempts | 0/9 · 0/9 | \n| Estimated cost, all 9 attempts | $3.52 | \n\nKimi K3.1 Pro places sixth of 16 by composite (86.5), the highest open-weight model, with a 95% rank interval of 3–9. It is third on the mechanical score alone (85.6, behind Claude Fable 5.2 and Claude Opus 5.5) and ninth on the judge score (88.6). In the bootstrap it finishes ahead of Claude Sonnet 5.5 in 54% of resamples, ahead of Claude Fable 5.1 in 35%, GPT-6.1 Sol in 33% and GPT-6 Astra in 27%, and ahead of Kimi K3 in more than 99%. All 9 attempts cost $3.52, about the same as Claude Opus 5.5 ($3.58), against $1.52 for Sonnet, $1.02 for Sol and $3.96 for Kimi K3.\n\nAll 9 attempts planned, with no security findings. Kimi K3 had four findings and one failed gate. S3 (G001) is its strongest fixture, tied fourth in the field by median composite (85.6, with Claude Fable 5.1). App Service (G003) has its highest median (87.8) but places eighth, and Cloud SQL (G002) places seventh (86.0, up from 79.2 for Kimi K3).\n\n| Fixture | Composite median (range) | Rubric median | Expertise | Judge median | ✗ gate | ⚠ security | Median inputs | Median output tokens | Median time | Median cost | \n|---|---|---|---|---|---|---|---|---|---|---|\n| G001 · S3 | 85.6 (84.0–86.4) | 0.849 | 4/7 | 92.1 | 0/3 | 0/3 | 12 | 12,640 | 526 s | $0.174 | \n| G002 · Cloud SQL | 86.0 (84.2–91.8) | 0.875 | 7/9 | 86.8 | 0/3 | 0/3 | 24 | 19,216 | 720 s | $0.300 | \n| G003 · App Service | 87.8 (84.7–87.8) | 0.889 | 4/5 | 86.8 | 0/3 | 0/3 | 51 | 42,983 | 1866 s | $0.669 | \n\nRubric items not at full credit, counted over attempts that planned: G001: `A5` 3/3, `H12` 3/3, `H13` 3/3, `H15` 3/3; G002: `A8` 1/3, `B1` 3/3, `H4` 3/3, `H5` 3/3, `H9` 1/3, `H11` 2/3; G003: `A7` 3/3. Definitions are in [Scoring criteria](https://www.massdriver.cloud/blogs/iac-bench-2026-10-scoring-criteria).\n\n`ssl_mode = \"ENCRYPTED_ONLY\"` is a\nliteral in 3/3 attempts, next to `ipv4_enabled = false` (`H2` passes 3/3; Kimi K3 failed\nit 3/3 by validating an input that admitted unencrypted connections). No S3 attempt offers\npublic reads (`H1`, which Kimi K3 lost in 1/3).` cloudsql.iam_authentication = \"on\"` last, so\nit cannot be overridden. `log_connections` and `log_disconnections` are on in 3/3 (E8,\nwhich Kimi K3 misses in 3/3).`health_check_eviction_time_in_min`, the pairing that failed Kimi K3's gate. Autoscale,\n`WEBSITES_PORT`, metric alerts and `AcrPull` (E1–E4) appear in 3/3; Key Vault references\n(E5) in none.`B1` is lost in 3 of 9 attempts, all on Cloud SQL,\nagainst 6 of 9 for Kimi K3 and Claude Fable 5.1 and 5 of 9 for GPT-6.1 Sol.`A7` scores zero in 3/3. Kimi K3 used 20–34, and the next-largest median is\nGemini 3.6 Flash at 40. Many are attribute pass-throughs (`ip_restrictions`,\n`vnet_route_all_enabled`, `container_start_time_limit`). `container_registry_id` beside\n`container_registry_url` in 3/3, and a managed identity's client ID beside its principal\nID in e2. A registry password is accepted as an alternative to `.gserviceaccount.com` suffix, which Cloud SQL rejects,\nin 3/3 (Kimi K3 trims it in 3/3). The e1 and e3 READMEs document the full email as the\nusername: `H4`/` H5` at 0.75,\n3/3), where Kimi K3 offered one;`ENTERPRISE_PLUS` (35 days) is offered; Cloud SQL provider ranges such as\n`>= 5.20.0, < 7.0.0` that span two majors; no AWS provider block (`H15`, 3/3); S3 over\nbudget with 12–13 inputs (`A5`, 3/3).` H11` lost 2/3).`deletion_policy`.\ne2 defaults it to `ABANDON` through an `optional()` attribute of the `databases` map,\nwhich earns full credit.`H13`, 3/3).` logging.amazonaws.com`\ninstead of `logging.s3.amazonaws.com` (excerpt below).`cloudsql.instanceUser` and\n`cloudsql.client` to each IAM user (E6), which Kimi K3 never does. Validation stays as\ndense as Kimi K3's: 20–21 blocks per Cloud SQL module, 22–28 per App Service module.\n`G001/kimi-k3.1-pro-e2/main.tf` lines 254–270\n\n```\n  statement {\n    sid    = \"AllowServerAccessLogDelivery\"\n    effect = \"Allow\"\n\n    principals {\n      type        = \"Service\"\n      identifiers = [\"logging.amazonaws.com\"]\n    }\n\n    actions   = [\"s3:PutObject\"]\n    resources = [\"${aws_s3_bucket.logs[0].arn}/access-logs/*\"]\n\n    condition {\n      test     = \"ArnLike\"\n      variable = \"aws:SourceArn\"\n      values   = [aws_s3_bucket.this.arn]\n    }\n```\n\nThe one S3 attempt that creates its own log bucket also writes a delivery grant for it, scoped to this bucket's ARN, but names the service principal logging.amazonaws.com. S3 server access logs are delivered by logging.s3.amazonaws.com, so the statement admits nothing and the rubric's delivery check (H13) fails.\n\nHow Claude Fable 5.1 did on iac-bench 2026-10: an overall composite of 86.9, scores per fixture, strengths, weaknesses and the patterns in its OpenTofu modules.\n\nHow Claude Fable 5.2 did on iac-bench 2026-10: an overall composite of 93.9, scores per fixture, strengths, weaknesses and the patterns in its OpenTofu modules.\n\nHow Claude Haiku 5.5 did on iac-bench 2026-10: an overall composite of 68.0, scores per fixture, strengths, weaknesses and the patterns in its OpenTofu modules.", "url": "https://wpnews.pro/news/kimi-k3-1-pro-on-iac-bench-2026-10", "canonical_source": "https://www.massdriver.cloud/blogs/iac-bench-2026-10-kimi-k3-1-pro", "published_at": "2026-11-04 00:00:00+00:00", "updated_at": "2026-11-11 17:24:51.957307+00:00", "lang": "en", "topics": ["large-language-models", "ai-research", "ai-tools", "ai-agents", "mlops"], "entities": ["Kimi K3.1 Pro", "Moonshot AI", "OpenRouter", "Claude Fable 5.2", "Claude Opus 5.5", "Claude Sonnet 5.5", "GPT-6.1 Sol", "Kimi K3"], "also_reported_by": [], "takeaway": "Kimi K3.1 Pro reached an 86.5 composite on iac-bench 2026-10 with 0 failed gates and 0 security findings across 9 attempts for $3.52 total, versus Kimi K3's four security findings and one failed gate at $3.96.", "recommendation": null, "alternates": {"html": "https://wpnews.pro/news/kimi-k3-1-pro-on-iac-bench-2026-10", "markdown": "https://wpnews.pro/news/kimi-k3-1-pro-on-iac-bench-2026-10.md", "text": "https://wpnews.pro/news/kimi-k3-1-pro-on-iac-bench-2026-10.txt", "jsonld": "https://wpnews.pro/news/kimi-k3-1-pro-on-iac-bench-2026-10.jsonld"}}