{"slug": "nbcuniversals-seamless-migration-unlocking-scalable-analytics-with-databricks", "title": "NBCUniversal’s Seamless Migration: Unlocking Scalable Analytics with Databricks", "summary": "NBCUniversal achieved a 30% reduction in data infrastructure costs and onboarded over 300 analysts onto Databricks SQL after migrating to the Databricks Data Intelligence Platform, according to a blog post by NBCUniversal and EXL executives. The migration, executed with consultancy EXL, unified analytics and machine learning on a single platform, enabling elastic scaling for high-traffic events without pre-reserved slot waste.", "body_md": "Transforming data infrastructure into a competitive advantage\n\nby [Kevin Hill](/blog/author/kevin-hill-nbcu), [Ludwig Kuznia](/blog/author/ludwig-kuznia-nbcu), [Anil Joshi](/blog/author/anil-joshi), [Jay Mehta](/blog/author/jay-mehta) and [Manojit Dan](/blog/author/manojit-dan-exl)\n\nAs one of the world's leading media and entertainment companies, NBCUniversal relies on data to deliver unparalleled entertainment experiences across its global broadcast, cable, and streaming networks. With content delivery demanding real-time analytics, complex data pipelines, and advanced machine learning, the company's data infrastructure is a critical business asset that supports decision making across the portfolio.\n\nNBCUniversal has been at the forefront of innovation for 100 years and recognized a need to modernize its data infrastructure to support its growing content ecosystem while maintaining operating costs. As data volumes grew and analytics demands evolved, the company sought a more scalable and integrated solution. The existing infrastructure supported core analytics needs, but also highlighted opportunities to enhance flexibility, improve performance for advanced workloads, and optimize compute expenses to strengthen operational efficiency.\n\n“NBCUniversal has been on a journey to operationalize and broaden access to data for teams across the company, this required a new solution that allowed us to work faster,” said Kevin Hill, Senior Vice President, Data Technology and Product, NBCUniversal. “Databricks provided us with a way to spend less time building and more time analyzing the data.”\n\nWhen NBCUniversal set out to modernize its data platform, the goal was to unlock the agility to scale around major content launches, awards shows, and live events without overprovisioning. Partnering with EXL and Databricks, NBCUniversal migrated onto Databricks' job-specific compute, unifying analytics and ML on a single platform and bringing 300 analysts along for the ride.\n\n30% reduction in data infrastructure costs via job-specific compute\n\n300+ analysts onboarded smoothly onto Databricks SQL\n\nElastic scaling for high-traffic events without pre-reserved slot waste\n\nUnified ML + analytics through MLflow and Lakeflow Jobs\n\nAs NBCUniversal continued to innovate, data became even more critical to decision making within organizations across teams like marketing, product, and content. The existing architecture could no longer sufficiently manage the amount of data or queries needed to support the rapidly evolving organization. A slot-based reservation model allowed the organization to reserve numerous slots to support these parallel workloads, but resulted in significant compute costs and resource contention.\n\n“As today’s content ecosystem rapidly evolves, our partners across the company need to make informed decisions faster,” said Louie Kuznia, Vice President, Data Engineering, NBCUniversal. “Databricks provided a solution that could support us in modernizing NBCUniversal’s data infrastructure without compromising agility or speed.”\n\nEvolving cost considerations, along with the desire for greater flexibility for advanced use cases such as machine learning and enhanced governance around data lineage, motivated NBCUniversal to explore alternative platforms.\n\nNBCUniversal partnered with Databricks and[ EXL](https://www.exlservice.com/), a global consultancy, to execute a strategic migration to the[ Databricks Data Intelligence Platform](https://www.databricks.com/product/data-intelligence-platform). This partnership combined EXL's deep migration expertise with Databricks’ leading data solutions to create a modernized data infrastructure supporting data engineering, machine learning, and advanced analytics.\n\nThe decision to work with Databricks offered several advantages, including enhanced flexibility and overall efficiency for data workloads:\n\n**Unified analytics platform: **Databricks provides a single platform for data engineering, data science, machine learning, and business intelligence workloads, which eliminates the need to maintain multiple specialized tools.\n\n**Flexible lakehouse architecture:** Databricks leverages DeltaLake and Apache Iceberg™ with open source Apache Spark™ and[ Lakehouse (Databricks SQL)](https://www.databricks.com/product/databricks-sql), enabling flexible handling of both structured and unstructured data across diverse formats.\n\n**Advanced analytics capabilities:** Databricks excels in supporting complex analytics, including machine learning workloads, with native integration of MLflow for experiment tracking and model versioning.\n\n**Granular compute control: **Databricks’ architecture enables more granular control over compute resources, with each data pipeline running on dedicated compute rather than competing for shared slots.\n\nThe migration to Databricks requires transformations to data structures, modifications to code, adjustments to data formats, and careful orchestration of upstream and downstream dependencies. EXL and Databricks together developed a comprehensive, phased approach that minimized operational disruption while accelerating the transition.\n\nThe team began with comprehensive discovery, creating an inventory of existing workloads, tables, and codebases while thoroughly analyzing their dependencies. This assessment phase identified the artifacts requiring migration, organized them by priority, and established success criteria.\n\nThe design phase focused on mapping existing constructs to their Databricks equivalents while optimizing for cost and performance.\n\nKey design decisions included:\n\n**Workspace architecture:** Structuring workspaces according to the Databricks[ Well-Architected Framework](https://docs.databricks.com/aws/en/lakehouse-architecture/), mapping its best-practice pillars to NBCUniversal’s organizational structure and security requirements to ensure a scalable, secure, and future-proof environment.\n\n**Data governance strategy:** Implementing Unity Catalog as the central governance layer.\n\n**Compute strategy:** Defining job cluster configurations, instance types, and autoscaling policies tailored to each workload's requirements.\n\n**Storage layout:** Designing Delta Lake table structures with appropriate partitioning, clustering, and[ predictive optimization](https://docs.databricks.com/aws/en/optimizations/predictive-optimization) to automatically maintain efficient file layouts, statistics, and storage for sustained performance at scale\n\nBefore committing to a full-scale migration, EXL executed a targeted MVP using a representative subset of NBCU's workloads. This pilot phase served two purposes: to validate the migration approach and to develop custom automation tools that would accelerate the broader effort.\n\nDuring the MVP, EXL built four proprietary accelerators specifically for NBCU's environment:\n\n**SQL translation engine:** An intelligent code converter that analyzes SQL syntax and automatically transforms it into optimized Spark SQL, handling dialect differences, function mappings, and performance tuning.\n\n**Orchestration migrator:** A tool that parsed existing DAGs and regenerated them as Lakeflow Jobs, preserving dependencies and scheduling logic.\n\n**Data transfer orchestrator:** An automated pipeline that moved data to Delta Lake, selecting optimal transfer methods based on table size and update frequency.\n\n**Validation framework:** A comprehensive testing suite that compared query results, row counts, and aggregate statistics between source and target systems.\n\nThese accelerators transformed what would have been months of manual work into automated, repeatable processes with built-in quality checks.\n\nWith accelerators validated and the target architecture finalized, the team executed the migration in carefully sequenced waves. Rather than migrating all workloads simultaneously, they adopted a risk-based approach that prioritized high-value, lower-complexity pipelines first.\n\nEach migration wave followed a consistent pattern:\n\nThis iterative approach allowed the team to maintain business continuity and refine their processes with each wave, applying lessons learned to subsequent migrations.\n\nThe final phase before cutting over to Databricks involved running both platforms in parallel for an extended validation period. For several weeks, NBCUniversal operated dual pipelines, executing the same transformations in both the existing platform and Databricks while comparing the outputs.\n\nThis parallel operation served multiple critical functions:\n\nOnly after achieving consistent results across all validation metrics did NBCUniversal proceed with the final cutover, retiring existing workloads pipeline by pipeline with full confidence in the new platform.\n\nThe results of NBCUniversal's migration were substantial and measurable:\n\n**Compute cost reduction:** “By transitioning to Databricks’ job-specific compute, NBCUniversal achieved a 30% reduction in overall data infrastructure costs. Each pipeline now runs on its own dedicated compute resources, enabling independent scaling during peak workloads with automatic scale-down during low-demand periods.”--Ludwig Kuznia, Vice President, Data Engineering at NBCUniversal\n\n**Improved operational flexibility: **The parallel execution model provides greater agility in responding to business demands. During known high-traffic events (such as major content launches or awards shows), NBCUniversal can dynamically scale up job cluster capacity without affecting other workloads or incurring the waste of pre-reserved but underutilized slots.\n\n**Unified analytics capabilities:** Beyond cost, the migration unlocked new capabilities. NBCUniversal's data engineering teams gained access to unified ML operations through MLflow, enabling:\n\nExperiment tracking and model versioning\n\nStreamlined ML lifecycle from training to production\n\nAutomated workflow standardization through Lakeflow Jobs\n\n**Enhanced data culture: **The migration catalyzed broader organizational change. By simplifying infrastructure management and reducing operational overhead, NBCUniversal created conditions for a more agile, collaborative, and data-driven culture between the data engineering and the analyst teams. Teams could focus on business problems rather than infrastructure constraints.\n\n**Ease of analyst onboarding**: The migration enabled approximately 300 analysts to transition quickly and comfortably to Databricks, thanks to Databricks SQL’s full ANSI SQL compliance and an intuitive platform that streamlines query writing, dashboard creation, and analysis within a unified workspace.\n\nNBCUniversal's migration to Databricks demonstrates how strategic technology decisions can transform data infrastructure, unlocking greater efficiency and competitive advantage. By partnering with EXL and embracing Databricks’ lakehouse architecture, NBCUniversal not only lowered its run costs but also unlocked a more agile, unified platform that allows teams to experiment faster, bring new data products to market sooner, and respond more quickly to changing audience and advertiser needs.\n\nThe new platform gives NBCUniversal the ability to rapidly iterate on audience insights, optimize ad products in near real time, and support new monetization models that were difficult or too expensive to run before. This combination of lower costs, faster decision cycles, and a single environment for data, analytics, and ML turns the data platform into a differentiator, which enables NBCUniversal to move more quickly than competitors in how it understands, serves, and grows its audiences.\n\nReady to modernize your data infrastructure and unlock similar cost savings and analytics capabilities?\n\n**Connect with Databricks:**\n\nSpeak about your use case with Databricks[ Delivery Solutions Architects](https://www.databricks.com/blog/databricks-introduces-delivery-solution-architect) (DSAs).\n\nThroughout this migration, the DSA for NBCUniversal worked hand-in-hand with EXL to craft a strategy aligned to the customer's priorities. DSAs accelerate implementation, surface roadblocks early, and coordinate across teams — from assessment and architecture through execution and validation — providing the technical oversight needed to reduce risk and speed delivery. Connect with your Databricks account team to learn how a DSA can extend your migration team.\n\nVisit EXL’s[ website](https://www.exlservice.com/) to learn more about their suite of solutions, including[ EXLdata.ai](https://www.exlservice.com/services-and-solutions/data-modernization/exldata-ai).\n\nExplore[ partner-led migration options](https://www.databricks.com/partners) to accelerate your journey\n\nStart with an assessment of your current environment\n\nSubscribe to our blog and get the latest posts delivered to your inbox.", "url": "https://wpnews.pro/news/nbcuniversals-seamless-migration-unlocking-scalable-analytics-with-databricks", "canonical_source": "https://www.databricks.com/blog/nbcuniversals-seamless-migration-unlocking-scalable-analytics-databricks", "published_at": "2026-07-29 20:35:57+00:00", "updated_at": "2026-07-30 18:27:33.493773+00:00", "lang": "en", "topics": ["artificial-intelligence", "machine-learning"], "entities": ["NBCUniversal", "Databricks", "EXL", "Kevin Hill", "Louie Kuznia", "Databricks Data Intelligence Platform", "MLflow", "Lakeflow Jobs"], "alternates": {"html": "https://wpnews.pro/news/nbcuniversals-seamless-migration-unlocking-scalable-analytics-with-databricks", "markdown": "https://wpnews.pro/news/nbcuniversals-seamless-migration-unlocking-scalable-analytics-with-databricks.md", "text": "https://wpnews.pro/news/nbcuniversals-seamless-migration-unlocking-scalable-analytics-with-databricks.txt", "jsonld": "https://wpnews.pro/news/nbcuniversals-seamless-migration-unlocking-scalable-analytics-with-databricks.jsonld"}}