{"slug": "introducing-calibra-open-source-robot-dataset-observability", "title": "Introducing Calibra: Open-source Robot Dataset Observability", "summary": "Calibra, an open-source toolkit for robot dataset observability, has been released to help audit datasets, identify quality issues, and estimate training outcomes before training. The first public release includes a Robot Dataset Health Check interactive Space for auditing LeRobot datasets, a benchmark of 30 public LeRobot datasets with health scores and diagnostics, and a Python API/CLI for quality-aware coreset selection and training outcome prediction.", "body_md": "Hey everyone!\n\nI’d like to share **Calibra** which is an open-source toolkit for robot dataset observability.\n\nI realized that while robot learning has excellent tooling for training policies, it’s still difficult to understand the quality of a dataset *before* training. Calibra aims to help by auditing datasets, identifying potential quality issues, building quality-aware coresets, and estimating training outcomes.\n\nAs part of the first public release, we’ve launched:\n\n**Robot Dataset Health Check** — an interactive Space for auditing LeRobot datasets in seconds.\n\n**A benchmark of 30 public LeRobot datasets** with health scores, quality diagnostics, and community comparisons.\n\nThe full toolkit also includes quality-aware coreset selection, training outcome prediction, and a Python API/CLI.\n\n**Try it:** [Robot Dataset Health Check - a Hugging Face Space by omert27](https://huggingface.co/spaces/omert27/robot-dataset-health-check)\n\n**Source code:** [GitHub - omertt27/Calibra: Dataset observability and coreset selection for robotics imitation learning · GitHub](https://github.com/omertt27/Calibra)\n\nI’d really appreciate feedback from the Hugging Face and robotics communities.\n\nSome questions I’d love your thoughts on:\n\nWhich dataset quality metrics would be most useful for your workflow?\n\nAre there important diagnostics that are missing?\n\nIf you work with LeRobot datasets, would you use something like this before training?\n\nThanks for taking a look, i would be appreciated any feedbacks.", "url": "https://wpnews.pro/news/introducing-calibra-open-source-robot-dataset-observability", "canonical_source": "https://discuss.huggingface.co/t/introducing-calibra-open-source-robot-dataset-observability/178259#post_1", "published_at": "2026-07-28 13:12:02+00:00", "updated_at": "2026-07-28 13:37:37.611040+00:00", "lang": "en", "topics": ["robotics", "machine-learning", "ai-tools"], "entities": ["Calibra", "LeRobot", "Hugging Face", "GitHub"], "alternates": {"html": "https://wpnews.pro/news/introducing-calibra-open-source-robot-dataset-observability", "markdown": "https://wpnews.pro/news/introducing-calibra-open-source-robot-dataset-observability.md", "text": "https://wpnews.pro/news/introducing-calibra-open-source-robot-dataset-observability.txt", "jsonld": "https://wpnews.pro/news/introducing-calibra-open-source-robot-dataset-observability.jsonld"}}