1,656 Sources, 0 Inline Citations: What Grok’s web_search API Returns, and How to Count It A single-run evaluation by Mention Impossible of xAI's grok-4.7 on 24 software-buying questions found that the Responses API returned 1,656 URL annotations across the answers but zero inline citations with text positions, meaning the annotations were a de-duplicated copy of the model's search reading list rather than citations. The team counted three defensible totals from the same responses — 1,862 raw source URLs, 1,656 per-answer unique URLs and 1,524 globally unique URLs — and confirmed the annotated URL set matched the search-action URLs in 1,656 of 1,656 cases. The results were compared against ChatGPT, Claude, Gemini and Perplexity answering the same 24 questions that week. Disclosure: this article was written with the help of AI tools. The data collection, numbers and conclusions were checked by the Mention Impossible team against the raw API logs. A single-run evaluation of grok-4.7 on 24 questions, compared with ChatGPT, Claude, Gemini and Perplexity: three valid URL counts from the same responses, and the setup choices that can mislead a comparison. If you evaluate LLM answers with web search, at some point you write a line like citations = annotations. For OpenAI-style responses that is usually fine. For Grok's Responses API, in our run it wasn't: 24 answers came back with 1,656 URL annotations, and not one of them pointed to a place in the answer text. They were the model's full reading list, not citations. This post documents what we measured, how we counted it, where the counting can go wrong, and what the numbers look like next to four other engines asked the same questions. The data comes from Mention Impossible, a weekly measurement of which brands web-search LLMs name in answers to software-buying questions; the method is published at data.mentionimpossible.com/method https://data.mentionimpossible.com/method/ 10 . An earlier post 9 covered general traps in brand-mention measurement. This one is about a single API’s output format. The request body, minus the auth header: { "model": "grok-4.7", "input": {"role": "user", "content": "