arXiv:2609.38445v1 Announce Type: new Abstract: Frontier LLMs are increasingly used to automate scientific research through iterative search. We distinguish idea-driven search from solution-driven search and identify three core challenges: organizing evolving research ideas, selecting promising directions, and maintaining alignment between ideas and their implementations. To address these challenges, we introduce the Agentic Idea Manager (AIM), a fully autonomous framework for managing and exploring research directions in idea-driven automated research. Inspired by Bayesian optimization, AIM uses an Agentic Surrogate and an Agentic Acquisition mechanism to organize discovered ideas and guide their selection. A Solution Auditor maintains idea-solution integrity, while a Resource Planner adaptively allocates the remaining experimental budget across parallel search branches. Experiments on 10 AutoLab benchmark tasks show that AIM surpasses the strongest baseline by 1.6 percentage points on System Optimization tasks and 4.9 percentage points on long-horizon Model Development & CUDA tasks. Notably, AIM reaches the best baseline performance up to 3.1x faster in wall-clock time. We further provide a theoretical analysis of when searching over ideas becomes beneficial. Our analysis shows that explicit idea-level allocation makes semantic coverage directly controllable, and that broader coverage becomes increasingly valuable when competitive research directions are sparse among many plausible alternatives. Project Page: https://imhgchoi.github.io/agentic-idea-manager/
AIM: Agentic Idea Management for Automated Research
The Agentic Idea Manager (AIM), a fully autonomous framework for idea-driven automated research from a team publishing on arXiv as 2609.38445v1, surpassed the strongest baseline by 1.6 percentage points on System Optimization tasks and 4.9 percentage points on long-horizon Model Development & CUDA tasks across 10 AutoLab benchmark tasks, and reached the best baseline's performance up to 3.1x faster in wall-clock time. AIM combines an Agentic Surrogate and an Agentic Acquisition mechanism inspired by Bayesian optimization to organize and select research ideas, a Solution Auditor to maintain idea-solution integrity, and a Resource Planner that adaptively allocates remaining experimental budget across parallel search branches. The paper's theoretical analysis shows explicit idea-level allocation makes semantic coverage directly controllable, with broader coverage becoming more valuable when competitive research directions are sparse among many plausible alternatives.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.