{"slug": "seer-guides-frozen-research-agents-with-shared-decision-models", "title": "Seer Guides Frozen Research Agents With Shared Decision Models", "summary": "A paper titled Seer, posted to arXiv on Nov. 19, 2026, reports that guiding a frozen agent with two shared decision models — a tool-response simulator trained on 0.7 million observed tool call-response pairs and a value estimator trained on 1 million interaction-history samples — raised GAIA benchmark accuracy for Qwen3.5-4B from 13.6% to 41.7% and for Qwen3.5-9B from 22.3% to 50.5% at a candidate width of 32. Across six models and five benchmarks, the width of 32 improved on the base agent in 26 of 30 comparisons, though it underperformed the best-tested width in 14 of 40 settings. The authors note the results are author-reported without independent reproduction, that the estimator score is not a calibrated success probability, and that the study took no hardware measurements of cost, latency or energy.", "body_md": "For builders of [deep-research agents](https://forkast.news/learn/how-ai-agents-make-decisions/), the primary architectural challenge is comparing candidate next steps without making a real tool call for every discarded option. The [Seer paper](https://arxiv.org/html/2611.26423v1), with an [arXiv record](https://export.arxiv.org/api/query?id_list=2611.26423) dated Nov. 19, 2026, introduces a framework to address this by utilizing two shared decision models that guide a frozen agent at inference time: a tool-response simulator and a value estimator.\n\nThese components rely on distinct training signals to function. The simulator is trained on 0.7 million observed tool call-response pairs, learning to predict the likely output of a tool. Conversely, the value estimator is trained on 1 million samples derived from interaction histories, specifically labeled with discounted terminal correctness. This allows the estimator to score the potential of a history rather than the correctness of a single isolated action. Crucially, these checkpoints are frozen after training and reused across different agent models without further updates, providing a consistent decision-making layer.\n\nAt inference, the frozen agent proposes a set of candidate actions. The simulator predicts responses for these imagined branches, and the estimator subsequently scores the resulting histories. The framework employs depth-one imagined search, meaning each candidate extends the real history by exactly one imagined action before evaluation occurs. The candidate width, set to 32 in the experiments, represents the maximum number of proposed next actions at a single expansion point, rather than the generation of 32 complete, multi-step simulated research trajectories. Seer then commits to the action associated with the most-visited root edge. Only this selected action is executed, and only the actual tool response is integrated into the committed history. It is vital to distinguish that predicted content serves only to guide the selection process and does not constitute evidence of what a source actually returned.\n\nThe authors report significant performance gains on question-answering benchmarks. On the [GAIA benchmark](https://arxiv.org/abs/2311.12983), which evaluates reasoning and tool-use proficiency, a candidate width of 32 reportedly increased accuracy for the Qwen3.5-4B model from 13.6% to 41.7%, and for the Qwen3.5-9B model from 22.3% to 50.5%. Across six tested models and five benchmarks, this width improved performance over the base agent in 26 of 30 comparisons. These results are author-reported, and independent reproduction has not yet been established.\n\nA critical distinction exists between external tool-call counts and total system cost. The [Seer paper](https://arxiv.org/html/2611.26423v1) reports that Seer achieves the highest accuracy on BrowseComp-200 while keeping real tool-call counts close to those of a Base Agent. The original [BrowseComp paper](https://arxiv.org/abs/2504.12516) describes its full benchmark as 1,266 questions requiring persistent internet navigation. Seer avoids real tool calls for discarded candidates but uses additional local inference and model memory. External-call counts alone do not quantify the inference spent on discarded branches or the total resource budget; the study did not take hardware measurements of cost, latency, or energy consumption.\n\nThere are inherent limits to the estimator’s utility. The authors clarify that the estimator score is not a calibrated success probability for a specific deployed policy; prediction and scoring errors can influence which branch the agent favors. Furthermore, a width of 32 performed worse than the best-tested width in 14 of 40 settings, indicating that wider search is not universally superior. The evaluation is currently limited to question-answering tasks and does not address open-ended research reports, evidence synthesis, or comprehensive coverage.\n\nFor builders, Seer represents a design pattern to evaluate when comparing tool-use options, rather than definitive proof of resource savings or a ready-to-deploy on-device solution. Its practical utility depends on whether task-specific accuracy gains justify the added local inference and memory overhead. The reported results leave the net resource trade-off unresolved: avoided calls to external tools must be assessed alongside the local inference and memory the guidance models add. The paper leaves that hardware-specific cost question unmeasured in this study.", "url": "https://wpnews.pro/news/seer-guides-frozen-research-agents-with-shared-decision-models", "canonical_source": "https://forkast.news/seer-guides-frozen-research-agents-with-shared-decision-models/", "published_at": "2026-11-22 12:57:51+00:00", "updated_at": "2026-11-22 13:14:48.570003+00:00", "lang": "en", "topics": ["ai-agents", "ai-research", "large-language-models", "ai-tools"], "entities": ["Seer", "arXiv", "Qwen3.5-4B", "Qwen3.5-9B", "GAIA benchmark", "BrowseComp-200"], "also_reported_by": [], "takeaway": "Seer's depth-one imagined search with a candidate width of 32 lifted GAIA accuracy from 13.6% to 41.7% on Qwen3.5-4B and from 22.3% to 50.5% on Qwen3.5-9B while keeping real tool calls near the base agent's, but width 32 lost to the best-tested width in 14 of 40 settings.", "recommendation": {"advice": "Before executing a tool call, simulate its likely response and score the resulting history with frozen decision models, then commit only the most-visited root action — but tune candidate width per task, since width 32 underperformed the best width in 14 of 40 settings.", "playbook": "agent-architecture", "playbook_url": "https://wpnews.pro/playbooks/agent-architecture"}, "alternates": {"html": "https://wpnews.pro/news/seer-guides-frozen-research-agents-with-shared-decision-models", "markdown": "https://wpnews.pro/news/seer-guides-frozen-research-agents-with-shared-decision-models.md", "text": "https://wpnews.pro/news/seer-guides-frozen-research-agents-with-shared-decision-models.txt", "jsonld": "https://wpnews.pro/news/seer-guides-frozen-research-agents-with-shared-decision-models.jsonld"}}