Use Genie Migrate for Lakehouse to accelerate data warehouse migrations and convert proprietary warehouse code into open SQL on Databricks.
by [Jonathan Brito](https://www.databricks.com/blog/author/jonathan-brito) and [Tommy Yu](https://www.databricks.com/blog/author/tommy-yu)
Companies are racing to build AI agents and applications. Every one of these use cases depends on easy access to their data, but for many enterprises, the data AI needs is locked inside of legacy data warehouses. Migrations are traditionally expensive and time-consuming, so many companies stay put and miss out on using AI to its full potential.
Genie Migrate is changing that equation. Genie Migrate for Lakehouse is a specialized coding agent, built on Genie Code, that automates the end-to-end migration lifecycle from legacy data warehouses. We are excited to announce that Genie Migrate now supports converting SQL code from 7 data warehouses to open ANSI SQL, all generally available: Microsoft SQL Server, Azure Synapse, Teradata, Oracle, Snowflake, Amazon Redshift, and Google BigQuery.
Genie Migrate for Lakehouse takes on the repetitive work of a migration, like assessing what files to migrate first, converting SQL scripts, and determining why conversions are failing, so your engineers can focus on reviewing and approving results. Four features keep the experience simple, from the first upload to the last approval:
Databricks migrations are already getting faster as teams bring AI into the work. The median migration time from onboarding to production at Databricks has dropped by 25% over the past 6 months. Customers can retire costly legacy platforms and stop paying for them much sooner than before with the help of Genie Migrate.
Genie Migrate converted more than 90% of files correctly on benchmarks for all seven sources. There are three factors that drive high accuracy:
The result is open ANSI SQL that runs on Databricks, follows your team's standards, and keeps the original logic, so you move from conversion to validation faster.
While in Beta, Genie Migrate has already helped customers move to the lakehouse faster. MIXI is a Japanese digital entertainment, sports, and lifestyle company. Its MONSTER STRIKE team, which runs one of Japan's biggest mobile games, is moving the game's data mart pipelines from BigQuery to Databricks. The team runs approximately 120 daily BigQuery data marts covering user attributes, item masters, logins, gameplay, and purchases. For the migration, the team needed to keep its project conventions, such as how tables are named, how each daily job filters to its date, and how data types are converted. To migrate to the Lakehouse, MIXI rolled out Genie Migrate across their entire data estate. The straightforward experience made it easy to get started and scale conversions across their data marts. With custom skills, the team could also easily apply project-specific standards, accelerating the conversion from GoogleSQL. The agent handled much of the repetitive work, from analyzing source code and applying the team’s rules to converting code, checking the results, and retrying when it found an issue. This kept the process simple and reduced manual effort for the team.
“Genie Migrate gave us a fast, effective path for moving pipelines from BigQuery to Databricks. 85% of the files we tested ran successfully without manual edits, shifting our time from labor-intensive translation to reviewing and refining results. By combining AI-powered conversion with our project-specific standards, we were able to migrate quickly, consistently, and at scale.” - Taiki Watanabe, Data Engineer, MONSTER STRIKE Operations Division at MIXI, Inc.
Genie Migrate’s ease of use was matched by the accuracy of the conversions. Of the converted files the team tested, approximately 85% ran without errors and required no manual edits. The remaining tested files needed only simple one-line fixes. Genie Migrate consistently applied the team’s instructions across files, producing accurate, reviewable code. This allowed the engineers to focus on validating results, enabling the two-person team to efficiently advance their data mart migration with confidence.
Genie Migrate for Lakehouse is generally available today for all seven data warehouse sources. Support for ETL sources is coming soon. The quickest way to see what Genie Migrate can do is to try it on your own code: create a migration project in your Databricks workspace, upload a few SQL files, and compare the converted code side by side.
When you're ready to plan the full migration, contact your Databricks account team or read the Genie Migrate for Lakehouse documentation for supported sources, prerequisites, limits, and the end-to-end workflow.
Genie Migrate for Lakehouse is an AI coding agent from Databricks, built on Genie Code, that automates data warehouse migrations to the Databricks Lakehouse. It runs inside your Databricks workspace. It maps dependencies between files and tables, converts proprietary SQL to open ANSI SQL in parallel, checks and fixes its own output, and lets engineers compare and approve every converted file. Genie Migrate for Lakehouse is generally available.
Genie Migrate for Lakehouse converts SQL from seven data warehouses to open ANSI SQL on Databricks: Microsoft SQL Server, Azure Synapse, Teradata, Oracle, Snowflake, Amazon Redshift, and Google BigQuery. All seven sources are generally available. Support for ETL sources is coming soon.
On benchmarks, Genie Migrate converted more than 90% of files correctly for each of the seven supported sources. It checks its own output for syntax and semantic correctness, revises the code when a check fails, and applies your team's custom skills to every file it converts. At MIXI, about 85% of the tested BigQuery files ran without manual edits, and the rest needed only one-line fixes.
The median Databricks migration reduces timelines by 25%, as teams bring AI into migration work. Genie Migrate shortens the code conversion phase by converting files in parallel in the background, so engineers spend their time reviewing and approving results instead of rewriting SQL by hand.
Genie Migrate runs a data warehouse migration in five steps inside your Databricks workspace:
Subscribe to our blog and get the latest posts delivered to your inbox.