{"slug": "gemini-4-hydrogen-keeps-45-of-its-brand-recommendations-when-google-search-is-on", "title": "Gemini 4 Hydrogen keeps 45% of its brand recommendations when Google Search is switched on", "summary": "Gemini 4 Hydrogen answers keep only 45% of their brand recommendations when Google Search grounding is switched on, according to 10,701 prompt pairs tracked by AI visibility firm DEJAN between 13 and 18 November 2026. Grounded answers named 7.5 brands versus 6.4 from memory, took a median 16.8 seconds against 8.0 seconds, and produced thought summaries 3.5 times longer, while 21% of grounded summaries described live searches as a \"mental check\" or \"simulated search.\" Search results overruled memory on out-of-date brands: of 70 stale brands named in those passages, only 1 reached the final answer.", "body_md": "# Gemini 4 Hydrogen keeps 45% of its brand recommendations when Google Search is switched on\n\n10,701 brand-recommendation prompts run on Gemini 4 Hydrogen from memory and with Google Search: 45% brand overlap, double the response time, and thought summaries that call live searches \"simulated\".\n\nWe asked Gemini 4 Hydrogen the same 10,701 brand-recommendation questions twice, once from memory and once with Google Search grounding. On average 45% of the brands overlap between the two answers, and only 1.8% of answer pairs are identical. The grounded answers take twice as long (16.8 s against 8.0 s median), and their thought summaries are 3.5 times longer. In 21% of grounded summaries the model writes about a \"mental check\" or a \"simulated search\", sometimes adding \"if this were a live system\", while the call is running live searches. Search results still overrule out-of-date brands from memory: of 70 out-of-date brands named in those passages, 1 reached the final answer.\n\n## How the data was collected\n\nThe data comes from the daily AI visibility tracking in [DEJAN's app](https://app.dejan.ai/). Each tracked prompt runs twice on Gemini 4 Hydrogen: a memory call with no grounding, then the same prompt with Google Search grounding. Both calls return Gemini's thought summary, the paraphrased record of the model's reasoning that the Gemini API returns when thoughts are requested.\n\n- 10,701 prompt pairs, 3,503 distinct prompts, 119 tracked sites, collected 13 to 18 November 2026.\n- 17 property languages. 62% of pairs are English, 26% have no language set, and 12% are spread over 16 other languages.\n- Every figure below is a count or a pattern match. No language model was used to read or score the summaries.\n\n## The brand lists\n\nAverage brands per prompt pair. The memory answer names 6.4 brands and the search answer 7.5; 4.1 appear in both.\n\n| Per prompt pair, average | Value | \n|---|---|\n| Brands named from memory | 6.4 | \n| Brands named with search | 7.5 | \n| Kept in both | 4.1 | \n| Added by search | 3.4 | \n| Removed by search | 2.3 | \n| Kept brands at the same position | 39% | \n| First brand from memory still first with search | 65% | \n\nThree changes recur across the data.\n\nRenamed brands are replaced. ESPN BET appears 226 times from memory and 0 times with search, and the grounded summaries record its rename to theScore Bet. 26 brands appear at least 20 times from memory and at most 10% as often with search; according to the grounded summaries, 13 of them have been renamed or taken over.\n\nComparison sites move from the answer into the sources. NerdWallet is among the brands removed most often when search is on, and it appears in the grounded summaries as one of the sites the model read.\n\nSearch widens the list beyond the best-known names. One US insurer appears 88 times from memory and 340 times with search; one US personal-loan brand rises from 112 to 326.\n\n## The thought summaries\n\nThought summaries from memory (blue) and with Google Search (orange).\n\n| Measure | Memory | Search | \n|---|---|---|\n| Median summary length | 1,829 characters | 6,384 characters | \n| Median thinking tokens | 739 | 1,187 | \n| Median response time | 8.0 s | 16.8 s | \n| Brands named in the summary | 9.2 | 16.3 | \n| Brands named in the summary but left out of the answer | 3.7 | 9.0 | \n| Summaries with dates or \"latest\", \"current\" | 11% | 88% | \n| Summaries with \"verify\", \"confirm\", \"double-check\" | 20% | 75% | \n\nGrounded summaries are longer, so the rate per 1,000 characters is the fairer comparison. Date and recency words rise from 0.08 to 0.69 per 1,000 characters. Checking words rise from 0.12 to 0.31. Hedging words such as \"likely\", \"I recall\" and \"assuming\" stay level, at 0.39 from memory and 0.36 with search.\n\nA grounded summary usually runs in stages. It lists the brands the model already associates with the topic, states the search queries it plans to run, reports what the results show, and removes or adds brands with a stated reason. One summary for custom cycling jerseys lists a brand's custom programme from memory, then reads a search snippet saying the programme ran from 2019 to 2021 and drops it.\n\n## \"If this were a live system\"\n\n2,227 grounded summaries contain \"mental check\", \"simulated\", \"mental search\" or \"hypothetical search\". 2,218 of those calls ran at least one Google search.\n\n- 788 summaries say things like \"if this were a live system, I'd perform a brief search\" or \"a simulated quick search\".\n- 151 treat the current date as hypothetical, for example: \"This is a simulated environment, so I'm to imagine it's 2026.\"\n- In these passages the model confirms brands from memory. One summary reads: \"While ESPN BET was a significant player, I'd do a quick mental check to see if its branding or operational status might have shifted... Assuming it's still active... ESPN BET would also be on my radar.\"\n\nThe final answers do not follow this wording. 3,092 brand mentions sit inside \"mental check\" passages. 70 of them are brands that search almost never returns (at least 20 times from memory, at most 10% as often with search), and 1 of those 70 appeared in the final grounded answer. The ESPN BET summary above ended in an answer without ESPN BET.\n\n## The cost of thought summaries\n\nRequesting thought summaries adds time. In a separate test of 10 alternating pairs on a short yes/no prompt, Gemini 4 Hydrogen took 3.5 s median with summaries requested and 2.6 s without, and was slower with summaries in 8 of the 10 pairs.\n\n## Method notes\n\n- A pair is the memory call and the grounded call for the same run, model, tracked topic and prompt. 1,741 further pairs could not be matched one to one, most likely because the same prompt ran in two locations, and are excluded.\n- Brands are matched by the platform's normalised brand name.\n- Renames are taken from the grounded summaries, which report what the model read in its search results.\n- Thought summaries are Google's paraphrase of the model's reasoning, not the raw reasoning tokens.", "url": "https://wpnews.pro/news/gemini-4-hydrogen-keeps-45-of-its-brand-recommendations-when-google-search-is-on", "canonical_source": "https://dejan.ai/blog/gemini-4-hydrogen-keeps-45-of-its-brand-recommendations-when-google-search-is-switched-on/", "published_at": "2026-11-18 13:13:28+00:00", "updated_at": "2026-11-18 13:42:56.934314+00:00", "lang": "en", "topics": ["ai-search", "generative-engine-optimization", "large-language-models", "ai-products"], "entities": ["Gemini 4 Hydrogen", "Google Search", "Google", "DEJAN", "ESPN BET", "theScore Bet", "NerdWallet"], "also_reported_by": [], "takeaway": "Across 10,701 prompt pairs, Google Search grounding changed 55% of Gemini 4 Hydrogen's brand picks, doubled median latency to 16.8 seconds and cut out-of-date memory brands from 70 mentions to 1 in the final answer.", "recommendation": {"advice": "Run each brand or recommendation prompt twice, with and without grounding, and compare brand overlap and latency; DEJAN measured 45% overlap and 16.8 s versus 8.0 s median.", "playbook": "evals-testing", "playbook_url": "https://wpnews.pro/playbooks/evals-testing"}, "alternates": {"html": "https://wpnews.pro/news/gemini-4-hydrogen-keeps-45-of-its-brand-recommendations-when-google-search-is-on", "markdown": "https://wpnews.pro/news/gemini-4-hydrogen-keeps-45-of-its-brand-recommendations-when-google-search-is-on.md", "text": "https://wpnews.pro/news/gemini-4-hydrogen-keeps-45-of-its-brand-recommendations-when-google-search-is-on.txt", "jsonld": "https://wpnews.pro/news/gemini-4-hydrogen-keeps-45-of-its-brand-recommendations-when-google-search-is-on.jsonld"}}