{"slug": "genie-zeroops-now-in-public-beta-an-autonomous-agent-that-fixes-data-pipelines", "title": "Genie ZeroOps, now in public beta: An autonomous agent that fixes data pipelines, with lessons from 80,000 customer issues", "summary": "Databricks released Genie ZeroOps in public beta, an autonomous agent that detects, investigates and proposes fixes for data pipeline issues, after the private preview observed over 80,000 real customer issues across hundreds of companies. Databricks said more than half of those issues required organization-specific knowledge to triage and resolve, prompting new features including shared inboxes, custom agent instructions, notifications and one-click pull request creation. Workspace admins can enable Genie ZeroOps from the workspace Previews page, and the agent proposes fixes on a new branch but never changes production code or data without human approval.", "body_md": "Over half of the pipeline issues we saw needed company-specific knowledge to fix. So we built shared inboxes, custom agent instructions, and one-click PRs to help data teams triage faster.\n\nby  [Jeff Chou](https://www.databricks.com/blog/author/jeff-chou), [Kristóf Molnár](https://www.databricks.com/blog/author/krist-f-moln-r), [Lennart Kats](https://www.databricks.com/blog/author/lennart-kats), [Danny Chiao](https://www.databricks.com/blog/author/danny-chiao)  and  [Ray Zhu](https://www.databricks.com/blog/author/ray-zhu) \n\nIn June we [introduced Genie ZeroOps](https://www.databricks.com/blog/introducing-genie-zeroops), an autonomous agent that detects, investigates, and resolves data pipeline issues, such as upstream schema changes or data quality anomalies. Based on extensive private preview testing with hundreds of customers, we’ve added new features to help data teams triage issues faster - including inbox sharing, notifications, one-click PR creation, and the ability to add custom business instructions to follow specific company workflows. Today, Genie ZeroOps is available in Public Beta, and your workspace admin can turn it on from the workspace Previews page.\n\nData engineering teams are underwater, managing many thousands of pipelines a day. Some pipeline failures are easy to find and fix - a job fails, a pipeline update errors out, and someone gets paged. Others are silent - a table stops updating, or last night's load arrives with half its usual rows, and nobody notices until a dashboard shows the wrong number.\n\nEither way, the work that follows typically looks the same: a notification is sent, an engineer spends the next few hours manually investigating logs, upstream tables, and related assets, and finally a PR gets generated with the fix.\n\nGenie ZeroOps automates this entire manual workflow while maintaining security, governance, and recommendation quality, specifically guiding teams from initial issue alert to a pull request across five core steps:\n\nDuring the limited private preview, ZeroOps observed over 80,000 real customer issues across hundreds of companies, highlighting just how painful pipeline maintenance has become. We found that over half of issues require organization-specific knowledge to properly triage, rank, and resolve, which speaks to the fundamental need for custom context. Through this feedback, we identified and built several critical features every team needs to succeed with ZeroOps:\n\nDuring our private preview, we spoke with customers who were prototyping internal AI triage tools. We learned that while building a simple prototype has become easier, scaling automated triage across production environments introduces complex operational challenges that compound over time:\n\nGenie ZeroOps handles these complexities natively - leveraging direct access to your Unity Catalog, metadata, and pipeline lineage to resolve issues with full context.\n\nTry ZeroOps out for yourself! Have a workspace admin enable the ZeroOps feature. Then find the ZeroOps banner on the top of the pipelines page:\n\n[Read the documentation here for more details on how to get started.](https://docs.databricks.com/aws/en/zeroops/get-started)\n\nIf your team needs help onboarding ZeroOps to production, reach out to your account team to inquire about any workshops that we offer.\n\nNo, ZeroOps will never change your code or data without your direct approval. Today, it investigates the failure, proposes a fix and can push that fix to a new branch for a pull request. It never changes production code or data without a person reviewing it first.\n\nIt uses [Data Quality Monitoring](https://docs.databricks.com/data-governance/unity-catalog/data-quality-monitoring/) to flag tables whose commits arrive unusually late (freshness) or whose row counts fall below the expected range (completeness).\n\nZeroOps automatically triggers as soon as an issue is detected, without a prompt, so the analysis is ready before anyone looks. It also has built-in access to run history, Unity Catalog lineage, Delta history and DQM signals, and it works within your Unity Catalog permissions.\n\n[From the documentation](https://docs.databricks.com/aws/en/zeroops/#data-processing), It reads run logs, source code, upstream table metadata and samples, while respecting Unity Catalog permissions. It uses models hosted by Databricks inside our security perimeter. Model calls stay in your workspace's region, and the model provider doesn't retain prompts or responses.\n\nYes. Add a custom instruction to filter out unwanted notifications, or mark an insight as \"not an issue.\"\n\nSubscribe to our blog and get the latest posts delivered to your inbox.", "url": "https://wpnews.pro/news/genie-zeroops-now-in-public-beta-an-autonomous-agent-that-fixes-data-pipelines", "canonical_source": "https://www.databricks.com/blog/genie-zeroops-now-public-beta-autonomous-agent-fixes-data-pipelines-lessons-80000-customer", "published_at": "2026-11-19 21:14:07.479913+00:00", "updated_at": "2026-11-19 21:14:09.673035+00:00", "lang": "en", "topics": ["ai-agents", "ai-products", "mlops", "ai-tools", "artificial-intelligence"], "entities": ["Databricks", "Genie ZeroOps", "Unity Catalog", "Jeff Chou", "Kristóf Molnár", "Lennart Kats", "Danny Chiao", "Ray Zhu"], "also_reported_by": [], "takeaway": "Genie ZeroOps auto-triggers on detected pipeline issues using run history, Unity Catalog lineage, Delta history and Data Quality Monitoring signals, and pushes proposed fixes to a new branch for a pull request rather than altering production code or data without approval.", "recommendation": null, "alternates": {"html": "https://wpnews.pro/news/genie-zeroops-now-in-public-beta-an-autonomous-agent-that-fixes-data-pipelines", "markdown": "https://wpnews.pro/news/genie-zeroops-now-in-public-beta-an-autonomous-agent-that-fixes-data-pipelines.md", "text": "https://wpnews.pro/news/genie-zeroops-now-in-public-beta-an-autonomous-agent-that-fixes-data-pipelines.txt", "jsonld": "https://wpnews.pro/news/genie-zeroops-now-in-public-beta-an-autonomous-agent-that-fixes-data-pipelines.jsonld"}}