{"slug": "which-gemini-model-should-you-use-neon-argon-hydrogen-carbon-flash-or-gemma-it", "title": "Which Gemini Model Should You Use? Neon, Argon, Hydrogen, Carbon, Flash or Gemma. It Depends.", "summary": "A developer benchmarked eight Gemini and Gemma models through the same API endpoint and scoring code, finding the four Gemini 4 models (Hydrogen, Carbon, Argon and Neon) tied on accuracy at 30 of 30 AIME 2025 problems, so selection should come down to cost and speed. At the lowest thinking setting a hard problem cost $0.018 on Argon versus $0.049 on Neon, and Hydrogen was the fastest Gemini 4 model at 11.3 seconds median per problem against Neon's 40.8 seconds. Raising the thinking setting added nothing on Gemini 4 models but lifted Gemini 3.5 Flash-Lite from 18 to 24 of 30 AIME problems for 2.6 times the cost.", "body_md": "This article provides a step by step guide to choosing a Gemini API model by measured cost, thinking and speed. Gemini 4 Neon, announced on 2026-11-18, joins seven models measured here before: Gemma 4 26B and 31B, Gemini 3.5 Flash-Lite and 3.8 Flash, and Gemini 4 Hydrogen, Carbon and Argon. All eight answer the same questions through the same endpoint with the same scoring.\n\n[https://github.com/xbill9/gemma4-dev/tree/main/docs/gemini-which-model](https://github.com/xbill9/gemma4-dev/tree/main/docs/gemini-which-model)\n\nThe short version: on these tests the four Gemini 4 models are level on accuracy, so pick among them by cost and speed, and pick between tiers by how hard the work is.\n\nAnswer four questions in order and stop at the first yes.\n\nFor the best function-calling score, Neon leads at 0.9750, level with Argon and Gemma 4 31B at 0.9675. The steps below show where each number comes from.\n\n**Accuracy.** Hydrogen, Carbon, Argon and Neon solved all 30 AIME 2025 problems at their lowest thinking setting and again at their high setting. On these problems no Gemini 4 model can be ranked above another. The smaller models can: Flash-Lite solved 18 of 30 at its lowest setting, and Argon solved the 12 it missed and lost none (exact test, p < 0.001).\n\n**Cost.** At the lowest setting a hard problem cost $0.018 on Argon, $0.026 on Hydrogen, $0.032 on Carbon and $0.049 on Neon. On short problems (GSM8K) the order is the same: $2.39 per 1,000 on Argon and $6.76 on Neon.\n\n**Thinking.** Raising the setting bought nothing on Gemini 4 (30 of 30 either way) for 1.9 to 4.6 times the cost. It paid on the smallest paid model: Flash-Lite went from 18 to 24 of 30 (+6 / −0, p = 0.031) for 2.6 times the cost.\n\n**Speed.** With every model running at the same time on AIME 2025 II, Hydrogen was the fastest Gemini 4 model at its lowest setting (11.3 s median per problem) and Neon the slowest (40.8 s).\n\n**Neon against Carbon.** At high thinking, the setting Google compares them at, Neon cost 0.73 times Carbon per problem, cheaper on 13 of 15 problems (paired test, p < 0.001), with the same 15 of 15 on AIME 2025 II. Its median time was 0.68 times Carbon's, but it was faster on only 9 of 15 problems, which could be chance. Google states 32% lower cost per task than Carbon on the Artificial Analysis Intelligence Index.\n\n**What to do with it.**\n\n**Caveats.** AIME 2025 has been public since early 2025, so some models may have seen these problems in training; that would raise every Gemini 4 score alike and is untested here. On 30 problems near 90% right, a gap has to be about 15 points before it can be told from chance, so close scores here are ties. Google positions Neon and Carbon for long agent and coding work, which none of these tests measures.\n\n| Model | Price in / out, per 1M tokens | Lowest setting | High setting | \n|---|---|---|---|\n| Gemma 4 31B, 26B | free tier only | `minimal` | `high` | \n| Gemini 3.5 Flash-Lite | $0.30 / $2.50 | `minimal` | `high` | \n| Gemini 3.8 Flash | $0.75 / $3.75 | `low` | `high` | \n| Gemini 4 Hydrogen | $1.50 / $7.50 | `low` | `xhigh` | \n| Gemini 4 Carbon | $2.00 / $10.00 | `low` | `high` | \n| Gemini 4 Argon | $2.00 / $10.00 | `low` | `high` | \n| Gemini 4 Neon | $3.00 / $15.00 | `low` | `high` | \n\nOutput prices include thinking tokens. Carbon and Argon go to $4 / $20 on 2026-12-01. Neon is paid tier only. 3.8 Flash and the Gemini 4 models accept `none` and run it as `low`; Neon was sent `low` on AIME 2025 I and `none` elsewhere and thought on every problem either way. Hydrogen's high setting is its top, `xhigh`; Neon's is `high`, Google's default for it.\n\nThree tests, each scored in code, temperature 0:\n\nCosts are the tokens each reply reported times the list price.\n\n| Model | GSM8K | BFCL | GSM8K, per 1,000 | BFCL, per 1,000 | Thinks on, GSM8K | \n|---|---|---|---|---|---|\n| Gemma 4 31B | 0.9735 | 0.9675 | 🥇 free | 🥇 free | 0% | \n| Gemma 4 26B | 0.9742 | 0.9575 | 🥇 free | 🥇 free | 0% | \n| 3.5 Flash-Lite | 0.9629 | 0.9350 | $0.66 | $0.13 | 0% | \n| 3.8 Flash | 0.9788 | 0.9400 | $1.26 | $0.36 | 98% | \n| Gemini 4 Hydrogen | 0.9803 | 0.9550 | $3.42 | $1.26 | 100% | \n| Gemini 4 Carbon | 0.9803 | 0.9600 | $2.81 | $0.78 | 20% | \n| Gemini 4 Argon | 🥇 0.9841 | 0.9675 | $2.39 | $0.78 | 5% | \n| Gemini 4 Neon | 0.9818 | 🥇 0.9750 | $6.76 | $2.87 | 100% | \n\nNeon's GSM8K score is level with 3.8 Flash and every Gemini 4 model and ahead of both Gemma 4 models and Flash-Lite. Its BFCL score is ahead of Hydrogen, 3.8 Flash and Flash-Lite and level with Carbon, Argon and Gemma 4 31B. Each comparison is an exact paired test by question, and \"ahead\" means p < 0.05.\n\nHydrogen and Neon think on every request even at their lowest setting, and that sets the bill: Neon cost 2.8 times Argon per GSM8K problem.\n\nAIME 2025 I and II together, 30 problems:\n\n| Model | Lowest setting | High setting | \n|---|---|---|\n| Gemma 4 31B | 12 of 15 (AIME I) | 13 of 15 (AIME I) | \n| Gemma 4 26B | 9 of 15 (AIME I) | 11 of 15 (AIME I) | \n| 3.5 Flash-Lite | 18 | 24 | \n| 3.8 Flash | 27 | 29 | \n| Gemini 4 Hydrogen | 🥇 30 | 🥇 30 | \n| Gemini 4 Carbon | 🥇 30 | 🥇 30 | \n| Gemini 4 Argon | 🥇 30 | 🥇 30 | \n| Gemini 4 Neon | 🥇 30 | 🥇 30 | \n\nGemma 4 on the free tier is shown for AIME I only.\n\nWith 30 of 30 the 95% range on each Gemini 4 score is 0.89 to 1.00, so these problems show that all four solve them and cannot say which solves them best. 3.8 Flash at its lowest setting missed 3 that Argon solved; on 30 problems that could be chance (p = 0.25).\n\n| Model | High against lowest, 30 problems | Cost, high ÷ lowest | \n|---|---|---|\n| 3.5 Flash-Lite | +6 / −0, p = 0.031 | 2.63x | \n| 3.8 Flash | +2 / −0, p = 0.50 | 3.45x | \n| Gemini 4 Hydrogen | +0 / −0 | 4.61x | \n| Gemini 4 Carbon | +0 / −0 | 3.76x | \n| Gemini 4 Argon | +0 / −0 | 2.78x | \n| Gemini 4 Neon | +0 / −0 | 1.86x | \n\nMean thinking per hard problem at the lowest setting was 118 tokens on Argon, 542 on Carbon, 2,314 on Neon and 2,406 on Hydrogen. Argon and Carbon decide on their own how much to think, and on most problems they barely do.\n\nMedian seconds per AIME 2025 II problem, every model running at the same time:\n\n| Model | Lowest setting | High setting | \n|---|---|---|\n| 3.5 Flash-Lite | 🥇 7.5 | 27.9 | \n| 3.8 Flash | 18.3 | 89.0 | \n| Gemini 4 Hydrogen | 11.3 | 61.2 | \n| Gemini 4 Argon | 16.8 | 41.3 | \n| Gemini 4 Carbon | 20.2 | 109.1 | \n| Gemini 4 Neon | 40.8 | 73.7 | \n\nOn short problems, in the 2026-11-14 run of the first seven models together: Flash-Lite 1.10 s per GSM8K problem, Hydrogen 2.84 s, 3.8 Flash 3.79 s, Carbon 7.34 s and Argon 7.63 s.\n\n| AIME 2025 II, high setting | Neon | Carbon | Neon ÷ Carbon | \n|---|---|---|---|\n| Right | 15 of 15 | 15 of 15 |  | \n| Cost per problem | $0.080 | $0.110 | 0.73x | \n| From 2026-12-01 | $0.080 | $0.220 | 0.36x | \n| Median time | 73.7 s | 109.1 s | 0.68x | \n| Thinking per problem | 4,547 | 9,718 | 0.47x | \n\nNeon reaches the same answers as Carbon with half the thinking, and was cheaper on 13 of the 15 problems. It was faster on 9 of 15, so the time difference could be chance. Argon at the same setting cost $0.048 a problem and took 41.3 s for the same 15.\n\nList price per token misleads. Hydrogen has the lowest Gemini 4 price and Argon cost less per hard problem at the lowest setting ($0.018 against $0.026), because Argon thought on few problems and Hydrogen on all of them. Run 20 to 50 of your own requests on each candidate and divide the bill by the number right.\n\n|  | Flash-Lite | 3.8 Flash | Hydrogen | Argon | Carbon | Neon | Gemma 4 31B | \n|---|---|---|---|---|---|---|---|\n| Hard problems, lowest | 18 / 30 | 27 / 30 | 30 / 30 | 30 / 30 | 30 / 30 | 30 / 30 | 12 / 15 | \n| Cost per hard problem, lowest | 🥇 $0.013 | $0.015 | $0.026 | $0.018 | $0.032 | $0.049 | 🥇 free | \n| From 2026-12-01 | $0.013 | $0.015 | $0.026 | $0.036 | $0.064 | $0.049 | free | \n| Time per hard problem, lowest | 🥇 7.5 s | 18.3 s | 11.3 s | 16.8 s | 20.2 s | 40.8 s | AIME I only | \n| Thinks on every request | no | most | yes | rarely | sometimes | yes | no | \n| Best function-calling score | 0.9350 | 0.9400 | 0.9550 | 0.9675 | 0.9600 | 🥇 0.9750 | 0.9675 | \n\n| Work | Use | Why, measured | \n|---|---|---|\n| Hard reasoning, cost first | Gemini 4 Argon, lowest | 30 of 30, $0.018 a problem | \n| Hard reasoning, speed first | Gemini 4 Hydrogen, lowest | 30 of 30, 11.3 s a problem | \n| Hard reasoning from 2026-12-01 | Gemini 4 Hydrogen, lowest | 30 of 30, $0.026 against Argon's $0.036 | \n| Work that needs high thinking | Gemini 4 Neon, high | Carbon's score at 0.73x the cost | \n| Function calling, best score | Neon, or Argon for less | 0.9750 at $2.87 per 1,000; Argon 0.9675 at $0.78 | \n| Short math, lowest paid cost | 3.8 Flash | GSM8K 0.9788 at $1.26 per 1,000 | \n| Fastest reply on easy work | 3.5 Flash-Lite | 1.10 s per GSM8K problem, $0.66 per 1,000 | \n| Free, private or offline | Gemma 4 31B | GSM8K 0.9735, BFCL 0.9675, free tier, or on your own GPU | \n\nThe goal of this article was to place every Gemini API model, Neon included, by what it gets right, what it costs and how fast it answers. The key to the solution was one scoring script, one endpoint and the same questions for all eight models. The results were:\n\nScope: one run per model and setting, temperature 0, through the Gemini API's OpenAI-compatible endpoint, between 2026-11-14 and 2026-11-19, at list prices on those dates. GSM8K and BFCL simple at the lowest setting only; 30 AIME 2025 problems at two settings, with Gemma 4 on AIME 2025 I only. Times compare only within one run. Long agent work, coding, and tests harder than AIME 2025 were not measured.\n\nThe strategy for choosing a Gemini model by measured cost, thinking and speed was validated with an incremental step by step approach.\n\nHope you enjoyed it!", "url": "https://wpnews.pro/news/which-gemini-model-should-you-use-neon-argon-hydrogen-carbon-flash-or-gemma-it", "canonical_source": "https://dev.to/gde/which-gemini-model-should-you-use-neon-argon-hydrogen-carbon-flash-or-gemma-it-depends-ano", "published_at": "2026-11-19 19:41:18+00:00", "updated_at": "2026-11-19 19:43:44.268718+00:00", "lang": "en", "topics": ["large-language-models", "ai-tools", "ai-products"], "entities": ["Google", "Gemini 4 Neon", "Gemini 4 Argon", "Gemini 4 Hydrogen", "Gemini 4 Carbon", "Gemini 3.5 Flash-Lite", "Gemma 4", "Artificial Analysis Intelligence Index"], "also_reported_by": [], "takeaway": "On 30 AIME 2025 problems the four Gemini 4 models all scored 30 of 30, so choose among them by cost and speed — Argon at $0.018 per hard problem versus Neon at $0.049 — and only raise thinking settings on smaller models like Flash-Lite, where it gained 6 problems for 2.6x cost.", "recommendation": {"advice": "Benchmark candidate models on your own tasks at the lowest thinking setting first; here Gemini 4 gained nothing from higher settings while Flash-Lite gained 6 of 30 AIME problems for 2.6x cost.", "playbook": "llm-cost", "playbook_url": "https://wpnews.pro/playbooks/llm-cost"}, "alternates": {"html": "https://wpnews.pro/news/which-gemini-model-should-you-use-neon-argon-hydrogen-carbon-flash-or-gemma-it", "markdown": "https://wpnews.pro/news/which-gemini-model-should-you-use-neon-argon-hydrogen-carbon-flash-or-gemma-it.md", "text": "https://wpnews.pro/news/which-gemini-model-should-you-use-neon-argon-hydrogen-carbon-flash-or-gemma-it.txt", "jsonld": "https://wpnews.pro/news/which-gemini-model-should-you-use-neon-argon-hydrogen-carbon-flash-or-gemma-it.jsonld"}}