{"slug": "hapbo-harnessed-alpha-pi-bayesian-optimization-via-expert-natural-language", "title": "HapBO: Harnessed $\\alpha$-$\\pi$ Bayesian Optimization via Expert Natural Language Priors", "summary": "Researchers introduced HapBO (Harnessed α-π Bayesian Optimization), a method that elicits prior beliefs once from a human expert, a large language model, or both, and deterministically compiles them into a reusable belief function π: X → [0,1] that requires no LLM calls during optimization. HapBO achieved the lowest aggregate regret across 40 HPOBench tasks, a synthetic suite in 6–15 dimensions, and improved outcomes in cortical neurostimulation and constrained solar design at budgets of 12–20 queries, at a small fraction of the wall-clock and token costs of other LLM-based methods. The authors prove that for the Expected Improvement acquisition function, HapBO preserves the standard simple-regret rate up to a bounded factor even under adversarial beliefs.", "body_md": "arXiv:2611.25100v1 Announce Type: new \nAbstract: Bayesian Optimization (BO) can be substantially more sample-efficient when informed by prior knowledge about the problem. In practice, however, such knowledge is often available only in natural language, e.g., expert intuitions or documentation, rather than as the explicit probability distribution landscape that prior-guided BO methods may require. Leveraging it effectively demands both an expressive mapping from language to priors and robustness to information that may be misleading. We propose HapBO (Harnessed $\\alpha$-$\\pi$ Bayesian Optimization), which elicits beliefs once from a human expert, a large language model (LLM), or both, and deterministically compiles a structured specification into a reusable belief function ($\\pi: \\mathcal{X} \\to[0,1]$), with a rich representation not restricted to a Gaussian family. Building on $\\alpha$-$\\pi$BO, HapBO applies this belief function through a bounded positive multiplier on any nonnegative acquisition, preserving positive acquisition support and requiring no LLM calls during optimization. We prove that, for the Expected Improvement acquisition function (EI), HapBO preserves the standard simple-regret rate up to a bounded factor, even under adversarial beliefs. We evaluate HapBO on 40 HPOBench tasks, a synthetic suite in 6-15 dimensions and two real-world applications: cortical neurostimulation and constrained solar design. HapBO achieves the lowest aggregate HPOBench regret and strong real-world task performance, with zero in-loop token cost. In real-world applications it improves the optimization outcome even at budgets of 12-20 queries, and at a small fraction of the wall-clock and token costs of other LLM-based methods.", "url": "https://wpnews.pro/news/hapbo-harnessed-alpha-pi-bayesian-optimization-via-expert-natural-language", "canonical_source": "https://arxiv.org/abs/2611.25100", "published_at": "2026-11-20 05:00:00+00:00", "updated_at": "2026-11-20 05:14:38.066769+00:00", "lang": "en", "topics": ["machine-learning", "ai-research", "large-language-models", "artificial-intelligence"], "entities": ["HapBO", "HPOBench", "Expected Improvement", "α-πBO"], "also_reported_by": [], "takeaway": "HapBO compiles expert or LLM priors once into a reusable belief function applied as a bounded positive multiplier on any nonnegative acquisition, achieving the lowest aggregate regret on 40 HPOBench tasks with zero in-loop token cost and preserving EI's simple-regret rate up to a bounded factor unde", "recommendation": {"advice": "When prior knowledge exists only as natural language, elicit it once and compile it into a fixed belief function rather than calling an LLM in the optimization loop; HapBO kept EI's regret rate and cut token cost to zero.", "playbook": "evals-testing", "playbook_url": "https://wpnews.pro/playbooks/evals-testing"}, "alternates": {"html": "https://wpnews.pro/news/hapbo-harnessed-alpha-pi-bayesian-optimization-via-expert-natural-language", "markdown": "https://wpnews.pro/news/hapbo-harnessed-alpha-pi-bayesian-optimization-via-expert-natural-language.md", "text": "https://wpnews.pro/news/hapbo-harnessed-alpha-pi-bayesian-optimization-via-expert-natural-language.txt", "jsonld": "https://wpnews.pro/news/hapbo-harnessed-alpha-pi-bayesian-optimization-via-expert-natural-language.jsonld"}}