Branch-and-Commit for Frozen RL Agents: When and Where to Spend Test-Time Compute
A new arXiv paper (2611.13003v1) on branch-and-commit finds that sampling and selecting among multiple continuations of a frozen reinforcement learning policy raised return by 12.8% in its main Craftax-Medium setting, bu…