{"slug": "how-to-add-live-telemetry-and-failure-diagnosis-to-isaac-lab-mujoco-or-gazebo-in", "title": "How to Add Live Telemetry and Failure Diagnosis to Isaac Lab, MuJoCo, or Gazebo Training in Under 5 Minutes", "summary": "SimTooReal, a platform for robotics teams, now enables live telemetry and failure diagnosis for training runs in Isaac Lab, MuJoCo, Gazebo, and LeRobot with a single command. The tool wraps existing training scripts to stream 28+ metrics in real time and recognizes over 50 failure patterns from logs, eliminating the need to wait for log files to debug issues. A free public diagnosis page and a transfer scoring tool further allow teams to compare simulation and real-world trajectories without overhauling their training stack.", "body_md": "If you train robot policies long enough, you eventually realize the main problem is not launching runs.\n\nIt is answering these questions fast enough:\n\nThis post walks through a practical approach using SimTooReal, a platform built for robotics teams working across Isaac Lab, MuJoCo, Gazebo, and LeRobot workflows.\n\nThe nice part is that the basic setup does not require rewriting your training loop.\n\nFrom the public docs and feature pages, the platform is built around a few concrete capabilities:\n\nFor this post, we will focus on the fastest path: getting live metrics and failure diagnosis around an existing run.\n\n```\npip install simtooreal-agent\n```\n\nThat is the shortest path shown in the docs.\n\nFor a generic training script:\n\n```\nsimtooreal-agent run -- python train.py --env HalfCheetah-v5 --algo ppo\n```\n\nFor an Isaac Lab run:\n\n```\nsimtooreal-agent run -- python scripts/rsl_rl/train.py --task Isaac-Ant-v0 --headless\n```\n\nThe agent sits around your existing command, parses stdout in real time, and streams metrics into the SimTooReal dashboard.\n\nThe docs route is here:\n\n`https://www.simtooreal.com/docs`\n\nOnce the run is wrapped, you can monitor live training behavior rather than waiting for logs to finish writing.\n\nThe platform advertises 28+ streamed signals. In practice, the most useful ones for day-to-day robotics training are likely to be:\n\nThe reason this matters is simple: a reward curve alone is not enough.\n\nI have seen runs where:\n\nIf you only check the final chart, you catch those issues too late.\n\nThis is the part I like most in the public feature set.\n\nSimTooReal's failure intelligence is designed to recognize more than 50 patterns from live logs, including:\n\nThe platform also exposes a free public diagnosis page:\n\n`https://www.simtooreal.com/diagnose`\n\nThat page accepts logs from frameworks like:\n\nSo even before you wire the full workflow, you can already use the diagnosis engine as a quick debugging surface.\n\nThe training monitor page also shows an optional direct integration path for teams that want deeper instrumentation.\n\nExample:\n\n``` python\nfrom isaacmonitor_sdk import MonitorClient\n\nclient = MonitorClient(run_id=\"my-run-001\")\n\nclient.log_metrics(\n    iteration=i,\n    mean_reward=mean_reward,\n    entropy=entropy,\n    reward_components={\n        \"velocity\": 0.8,\n        \"upright\": 0.6,\n        \"contact\": -0.1,\n    },\n)\n\nclient.log_failure(joint=\"knee_left\", reason=\"joint_limit_exceeded\")\nclient.finish_run()\n```\n\nIf your team already has a structured training loop and wants richer event data than stdout parsing alone, this is the cleaner path.\n\nOnce you start collecting trajectories from both sim and real hardware, the next useful step is the public transfer scoring tool:\n\n`https://www.simtooreal.com/score`\n\nThe CLI example from the product pages is:\n\n```\nsimtooreal score --sim sim_traj.csv --real real_traj.csv\n```\n\nAccording to the site, this compares trajectories with Dynamic Time Warping and returns a transfer score out of 100.\n\nThat is useful because it turns the vague statement \"transfer seems okay\" into something you can compare over time.\n\nThis is where the product goes beyond metrics collection.\n\nThe deployment flow on the site is built around:\n\nIf your team is already training policies successfully, this is the next maturity step. Training visibility helps you produce better checkpoints. Deployment gates help you avoid promoting the wrong ones.\n\nA lot of robotics infra tools fail because they ask for too much up front.\n\nWhat makes this workflow practical is that it gives you a progressive path:\n\nThat is a much better adoption curve than \"rebuild your training stack around our SDK.\"\n\nIf you work in robot learning, the gap between simulation and hardware is not just a modeling problem. It is a visibility problem and a decision problem.\n\nA good workflow should help you answer:\n\nThat is what SimTooReal is aiming to solve.\n\nUseful links:\n\n`https://www.simtooreal.com/docs`\n\n`https://www.simtooreal.com/features/train`\n\n`https://www.simtooreal.com/features/failures`\n\n`https://www.simtooreal.com/diagnose`\n\n`https://www.simtooreal.com/score`\n\n`robotics`\n\n, `machinelearning`\n\n, `python`\n\n, `ai`\n\n`How to Add Live Telemetry to Isaac Lab, MuJoCo, or Gazebo Training`\n\n`Start with the free diagnosis tool or the docs quickstart.`", "url": "https://wpnews.pro/news/how-to-add-live-telemetry-and-failure-diagnosis-to-isaac-lab-mujoco-or-gazebo-in", "canonical_source": "https://dev.to/simtooreal/how-to-add-live-telemetry-and-failure-diagnosis-to-isaac-lab-mujoco-or-gazebo-training-in-under-5-2416", "published_at": "2026-06-06 23:23:36+00:00", "updated_at": "2026-06-06 23:42:06.878277+00:00", "lang": "en", "topics": ["robotics", "machine-learning", "ai-tools", "mlops"], "entities": ["SimTooReal", "Isaac Lab", "MuJoCo", "Gazebo", "LeRobot", "HalfCheetah-v5", "PPO"], "alternates": {"html": "https://wpnews.pro/news/how-to-add-live-telemetry-and-failure-diagnosis-to-isaac-lab-mujoco-or-gazebo-in", "markdown": "https://wpnews.pro/news/how-to-add-live-telemetry-and-failure-diagnosis-to-isaac-lab-mujoco-or-gazebo-in.md", "text": "https://wpnews.pro/news/how-to-add-live-telemetry-and-failure-diagnosis-to-isaac-lab-mujoco-or-gazebo-in.txt", "jsonld": "https://wpnews.pro/news/how-to-add-live-telemetry-and-failure-diagnosis-to-isaac-lab-mujoco-or-gazebo-in.jsonld"}}