{"slug": "gemini-4-carbon-lags-just-behind-claude-in-benchmark-but-wins-in-value", "title": "Gemini 4 Carbon lags just behind Claude in benchmark, but wins in value", "summary": "SemiAnalysis's new GDPx benchmark, spanning 206 tasks across finance, materials science, cybersecurity, software engineering, legal and biology, ranks Anthropic's Claude Opus 5.5 first, with Google's Gemini 4 Carbon close behind at roughly $16 per task versus about $51 per task for Claude. Gemini 4 Carbon also beat OpenAI's GPT-6 Astra, which scored lower at about $54 per task; removing the cybersecurity, biology and alignment domains puts GPT-6 Astra on top, with GPT 6.1 Sol and Claude Sonnet 5.5 outranking Gemini 4 Carbon. Google announced Gemini 4 Carbon on October 28 but has not confirmed a public release date, saying it is \"coming soon\" for most customers.", "body_md": "Google’s new frontier model, Gemini 4 Carbon, brings some welcome improvements and while it doesn’t top the charts in a new benchmark, it does provide much more bang for your buck.\n\n*SemiAnalysis*, an AI research and analysis firm, r[ecently published](https://x.com/SemiAnalysis_/status/2117075900575477855) its new frontier-level benchmark, GDPx which includes numbers for Google’s Gemini 4 Carbon model. The leaderboard includes every major frontier model from the likes of OpenAI, Anthropic, and Meta and details both the score and cost for each model.\n\nThe benchmark includes 206 tasks across finance, materials science, cybersecurity, software engineering, legal, biology, and several other domains (topics).\n\nTopping the results is Anthropic’s Claude Opus 5.5, but Google’s Gemini 4 Carbon is very close behind. The difference between the two is relatively minimal, but the cost is the biggest factor to consider here. Where Claude’s cost came out to around $51 per task, Gemini was just over $16 per task. Gemini also beat the next model on the list, GPT-6 Astra, which scored lower while costing more than both at about $54 per task.\n\nThe report notes that taking out cybersecurity, biology, and alignment domains shuffles the results. Safety guardrails in Claude and GPT models puts GPT-6 Astra at the top of the list with GPT 6.1 Sol and Claude Sonnet 5.5 outranking Gemini 4 Carbon. *SemiAnalysis* says that this better aligns with their “subjective impressions” of each model. \n\nAs for Google’s existing frontier model, Gemini 4 Argon, it ranks in eighth place on both lists, beating Meta’s Muse Wonder, but below Wonder Full. Argon’s costs in this particular benchmark are only slightly lower than Carbon.\n\nBoth of Google’s models score better than OpenAI and Anthropic models when focused on cybersecurity, but do fall behind Meta’s Muse models, which the benchmark [found](https://x.com/SemiAnalysis_/status/2117075908301393972) to be the best “by a meaningful margin.”\n\nGoogle [announced Gemini 4 Carbon on October 28 and touted “significant gains,”](https://9to5google.com/2026/10/28/gemini-4-carbon-announcement/) but the public release date has not been confirmed just yet. It is “coming soon” for most customers. Google’s own benchmark, below, beat GPT-6 Astra and Opus 5.5 in many aspects.\n\n## More on Gemini:\n\n- [Latest Gemini design comes to all Android devices, app upgrades file generation](https://9to5google.com/2026/10/29/gemini-design-file-generation/)\n- [Google adding more Connected Apps to Gemini & Search with new dev platform](https://9to5google.com/2026/10/28/gemini-google-connected-apps-platform/)\n- [Google says Gemini 4 Argon ranks well behind Claude and GPT-6 for Android coding](https://9to5google.com/2026/10/26/android-bench-rankings-gemini-4-argon/)\n\n**Follow Ben:** [Twitter/X](https://twitter.com/NexusBen), [Threads](https://www.threads.net/@nexusben), [Bluesky](https://bsky.app/profile/nexusben.com), and [Instagram](https://www.instagram.com/nexusben)\n\n*FTC: We use income earning auto affiliate links.* [More.](https://9to5mac.com/about/#affiliate)\n\n[our homepage](http://9to5google.com/)for all the latest news, and follow 9to5Google on\n\n[exclusive stories](https://9to5google.com/feature/exclusive/),\n\n[reviews](https://9to5google.com/guides/reviews/),\n\n[how-tos](https://9to5google.com/guides/how-to/), and\n\n[subscribe to our YouTube channel](https://www.youtube.com/9to5google)", "url": "https://wpnews.pro/news/gemini-4-carbon-lags-just-behind-claude-in-benchmark-but-wins-in-value", "canonical_source": "https://9to5google.com/2026/11/02/gemini-4-carbon-benchmark/", "published_at": "2026-11-02 15:30:00+00:00", "updated_at": "2026-11-02 15:50:09.278952+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-research", "ai-products"], "entities": ["Google", "Gemini 4 Carbon", "SemiAnalysis", "Anthropic", "Claude Opus 5.5", "OpenAI", "GPT-6 Astra", "Meta"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/gemini-4-carbon-lags-just-behind-claude-in-benchmark-but-wins-in-value", "markdown": "https://wpnews.pro/news/gemini-4-carbon-lags-just-behind-claude-in-benchmark-but-wins-in-value.md", "text": "https://wpnews.pro/news/gemini-4-carbon-lags-just-behind-claude-in-benchmark-but-wins-in-value.txt", "jsonld": "https://wpnews.pro/news/gemini-4-carbon-lags-just-behind-claude-in-benchmark-but-wins-in-value.jsonld"}}