{"slug": "gpt-6-2-sol-is-a-regression-for-deep-research", "title": "GPT-6.2 Sol Is a Regression for Deep Research", "summary": "Vincent Schmalbach, who builds the article tool UnSpar, reverted UnSpar's deep research from GPT-6.2 Sol back to GPT-6.1 Sol after finding that OpenAI's November 17 release produced shorter, less detailed reports despite lower per-task cost. In a blind test across eight research topics graded by Claude Opus 5.5, GPT-6.2 Sol won 1 topic to GPT-6.1 Sol's 4 (plus 1 leaning), won 0 topics on depth to 6.1's 4, and averaged 1,390 words and 46 relevant details per report against 2,610 words and 51 details for 6.1. GPT-6.2 Sol is priced the same as 6.1 at $2 per million input tokens and $10 per million output tokens, and Artificial Analysis scores it 57 points at $1.01 per task versus 55 points at $1.27 for 6.1; Schmalbach wrote that raising reasoning effort to max still yielded about 1,200 words and 36 details per report, so \"I don't count research that finds less for less money as cheaper.", "body_md": "### Microsoft Shows How Not to Introduce AI in Your Business\n\nSince Thursday afternoon I can't use my Outlook. On November 12 Microsoft 365 went down worldwide. Exchange Online, which runs the email,…\n\nGPT-6.2 Sol is a clear regression from GPT-6.1 Sol for deep research. I switched deep research in [UnSpar](https://www.unspar.com/), the article tool I build, to 6.2 the day after OpenAI released it, and switched back the next morning. 6.2 writes research reports half as long as 6.1, with fewer details and fewer citations, and turning up the reasoning effort doesn't change that.\n\n[OpenAI released GPT-6.2 Sol](https://community.openai.com/t/gpt-6-2-astra-and-sol-are-now-available/1417531) on November 17 at the same price as 6.1, $2 per million input tokens and $10 per million output tokens. Artificial Analysis gives it [57 points on its index at $1.01 per task](https://artificialanalysis.ai/models/gpt-6-2-sol), against [55 points and $1.27](https://artificialanalysis.ai/models/gpt-6-1-sol) for 6.1. It looked smarter and cheaper, so I switched.\n\nMy first test agreed. I ran eight research topics, once through each model and had Claude Opus 5.5 grade the reports blind. Both models got nearly all of the five key questions per topic right. 6.2 won three topics head to head and 6.1 won one, and 6.2 was 18% cheaper and more than twice as fast. I deployed it. The same test also showed 6.2's reports at 1,370 words against 2,580, with 18 cited links instead of 26. I had built the test to check whether the key facts were right.\n\nFor the second test I had the judge list every concrete detail in each report and weigh depth as much as correctness, without counting length. Each pair was judged twice with the order swapped, and a topic only counts when both rounds agree. This time 6.2 also got a higher reasoning setting than 6.1.\n\n|  | GPT-6.1 Sol | GPT-6.2 Sol (higher reasoning) | \n|---|---|---|\n| Topics won (of 8) | 4, plus 1 leaning | 1 | \n| Topics won on depth | 4 | 0 | \n| Relevant details per report | 51 | 46 | \n| Words per report | 2,610 | 1,390 | \n\nAt the same reasoning setting, 6.2 used about 2,600 reasoning tokens per report where 6.1 used 7,100. With GPT-5.6 Sol I had the opposite problem, it [used twice the tokens](https://www.vincentschmalbach.com/gpt-5-6-sol-xhigh-uses-twice-tokens-gpt-5-5/) of the model before it. So I suspected the setting and turned it up. On two of the topics, 6.2 at max reasoned almost twice as much as 6.1 (10,600 tokens against 5,900), still wrote about 1,200 words, and listed 36 details per report, against 48 for 6.1 and 45 for itself one setting lower.\n\nThe price per token didn't change, so all of the savings come from 6.2 thinking and writing less. With the higher setting the saving shrinks to 8%. I don't count research that finds less for less money as cheaper.\n\nSo Deep research in UnSpar is back on 6.1.\n\nGive Vroni a GitHub issue, bug report, spec, or rough idea. It reads the repo, plans the change, writes code, runs checks, and works toward a review-ready pull request.\n\nTake a look at vroni.com", "url": "https://wpnews.pro/news/gpt-6-2-sol-is-a-regression-for-deep-research", "canonical_source": "https://www.vincentschmalbach.com/gpt-6-2-sol-regression-deep-research/", "published_at": "2026-11-19 08:32:40+00:00", "updated_at": "2026-11-19 08:43:55.423104+00:00", "lang": "en", "topics": ["large-language-models", "ai-research", "ai-products"], "entities": ["OpenAI", "GPT-6.2 Sol", "GPT-6.1 Sol", "UnSpar", "Vincent Schmalbach", "Claude Opus 5.5", "Artificial Analysis", "GPT-5.6 Sol"], "also_reported_by": [], "takeaway": "GPT-6.2 Sol at max reasoning used 10,600 reasoning tokens per report versus 5,900 for GPT-6.1 Sol yet still wrote about 1,200 words and 36 details against 48 for 6.1, so benchmark index gains did not translate into deeper research output.", "recommendation": {"advice": "Judge model upgrades with blind, order-swapped pairwise comparisons that weigh depth and count concrete details, not just key-fact accuracy or index scores, before switching a production pipeline.", "playbook": "evals-testing", "playbook_url": "https://wpnews.pro/playbooks/evals-testing"}, "alternates": {"html": "https://wpnews.pro/news/gpt-6-2-sol-is-a-regression-for-deep-research", "markdown": "https://wpnews.pro/news/gpt-6-2-sol-is-a-regression-for-deep-research.md", "text": "https://wpnews.pro/news/gpt-6-2-sol-is-a-regression-for-deep-research.txt", "jsonld": "https://wpnews.pro/news/gpt-6-2-sol-is-a-regression-for-deep-research.jsonld"}}