PyRUA-DataFarm: LLM Agent as a Cost-Efficient Teleoperator for Real-Ready Robot Data

Researchers introduced PyRUA-DataFarm, a system in which an LLM coding agent acts as a cost-efficient teleoperator to collect real-ready robot demonstration data, aiming to replace the default human teleoperation pipeline in which every episode costs robot and operator time and every new task starts from scratch. In the DataFarm setup, the agent receives a data request and a single calibration episode, then takes over the teleoperator's job.

Teleoperation remains the default way to collect robot demonstrations, but every episode costs robot and operator time, and every new task starts from scratch. We ask whether a coding agent can take over the teleoperator's job. In our DataFarm, the agent receives a data request and one calibration e