cd /news/robotics/training-reasoning-models-in-simulat… · home › topics › robotics › article
[ARTICLE · art-170708] src=arxiv.org ↗ pub= topic=robotics verified=true sentiment=↑ positive

Training Reasoning Models in Simulation to Natively Use Real Robots

An open-weight 27B reasoning model trained entirely in simulation with reinforcement learning succeeded in 60% of trials on a real dual-arm robot, where the base model succeeded in none, according to an arXiv paper submitted on 13 November 2026. Using a Post-training Engine for Agentic Robotics (PEAR) and robot-use reinforcement learning (RURL) on LIBERO and RoboDojo, the training raised LIBERO success from 1.6% to 74.4%, approaching GPT-6 Astra and GPT-6.1 Sol at maximum reasoning effort, and reached 57.4% on LIBERO-Pro versus 0.75% for the demonstration-fine-tuned vision-language-action model π0.5. The model retained its general capabilities with no measurable degradation on nine reasoning, coding and vision benchmarks, indicating simulation-trained robot-use reinforcement learning can transfer to unseen robots, the real world and novel instructions.

read2 min views4 publishedNov 16, 2026
Training Reasoning Models in Simulation to Natively Use Real Robots
Image: source
  [Submitted on 13 Nov 2026]


[View PDF](http://arxiv.org/pdf/2611.18562v1)

[HTML (experimental)](https://arxiv.org/html/2611.18562v1)

Abstract:Robot-use agents (RUAs) have emerged as a promising approach to general-purpose robot control. However, strong performance has so far been achieved only by frontier proprietary models such as GPT-6 Astra and Claude Fable 5.2, whereas open-weight models remain substantially less capable. We show that an open-weight 27B reasoning model can be trained to use real robots natively through reinforcement learning, entirely in simulation and without demonstrations. Like a computer-use agent (CUA), the model observes the environment, reasons in a chain of thought, and generates the next end-effector pose, without any harness. We build a Post-training Engine for Agentic Robotics (PEAR) and use it to train the model on simulated robot tasks at scale with robot-use reinforcement learning (RURL), mirroring how frontier models acquire computer use. We find that the skills acquired in simulation generalize well beyond the training tasks: they transfer to an unseen robot, to the real world, and to novel instructions. After training on LIBERO and RoboDojo in simulation, the model succeeds in 60% of our trials on a real dual-arm robot, whereas the base model succeeds in none. On LIBERO, training raises the success rate from 1.6% to 74.4%, approaching GPT-6 Astra and GPT-6.1 Sol at maximum reasoning effort. Compared with $\pi_{0.5}$, a vision-language-action model fine-tuned on demonstrations, our model is substantially more robust to changes in the task itself. On LIBERO-Pro, $\pi_{0.5}$ succeeds in only 0.75% of episodes when assigned a new task in a familiar scene whereas our model succeeds in 57.4%. Finally, the model retains its general capabilities, with no measurable degradation on nine reasoning, coding and vision benchmarks. These results highlight robot-use reinforcement learning as a promising component of foundation-model post-training.

Additional Features

References & Citations

...

Bibliographic Explorer

(What is the Explorer?) Connected Papers

(What is Connected Papers?) Litmaps

(What is Litmaps?) scite Smart Citations

(What are Smart Citations?) alphaXiv

(What is alphaXiv?) CatalyzeX Code Finder for Papers

(What is CatalyzeX?) DagsHub

(What is DagsHub?) Gotit.pub

(What is GotitPub?) Hugging Face

(What is Huggingface?) ScienceCast

(What is ScienceCast?) Influence Flower

(What are Influence Flowers?) CORE Recommender

(What is CORE?) arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

── more in #robotics 4 stories · sorted by recency
── more on @pear 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/training-reasoning-m…] indexed:0 read:2min 2026-11-16 · —