{"slug": "databricks-ai-runtime-and-nvidia-make-it-easier-to-customize-open-models-with", "title": "Databricks AI Runtime and NVIDIA make it easier to customize open models with enterprise data", "summary": "Databricks announced at GTC Berlin that its AI Runtime (AIR) is now generally available, letting developers train and fine-tune open models on serverless NVIDIA GPUs using NVIDIA NeMo, NGC containers and new Nemotron cookbooks, all inside the Databricks Platform. AIR supports multi-node distributed training with NVIDIA Quantum InfiniBand and NCCL networking while Databricks manages the underlying clusters, and teams can track experiments in MLflow and deploy models for real-time inference through Databricks Model Serving. Databricks CTO for Neural Networks Hanlin Tang said the combination \"will accelerate the rise of customized models in enterprise\" by bringing governed data access and large-scale training to machine learning engineers.", "body_md": "AI Runtime enables developers to use NVIDIA frameworks, OSS models, and containers across clouds on Databricks without managing GPU infrastructure\n\nby  [Tejas Sundaresan](https://www.databricks.com/blog/author/tejas-sundaresan), [Hanlin Tang](https://www.databricks.com/blog/author/hanlin-tang), [Julia Powell](https://www.databricks.com/blog/author/julia-powell), [Joel Caruso (NVIDIA)](https://www.databricks.com/blog/author/joel-caruso-nvidia)  and  [Mayank Tahilramani (NVIDIA)](https://www.databricks.com/blog/author/mayank-tahilramani-nvidia) \n\nGPUs power today's most advanced AI workloads, from cutting-edge language models to multimodal AI systems and agents. Increasingly, enterprises are adapting open models to their own data and business needs. But securing GPU access is only part of the challenge. Teams also need to configure training jobs, govern data access, and manage GPU infrastructure, leaving less time to experiment with models and evaluate how well they meet business needs.\n\nDatabricks and NVIDIA provide a seamless path from enterprise data to customized AI models, from fine-tuning smaller models to large-scale distributed training. Through Unity Gateway, Databricks provides developers with governed access to frontier and open-source models. For teams that need to customize models, AI Runtime (AIR) brings NVIDIA’s AI software ecosystem and serverless GPUs to enterprise data. Teams can experiment, fine-tune, and evaluate models on AIR, then deploy them for real-time inference through Databricks Model Serving — all within the Databricks Platform, with less infrastructure and governance work to manage.\n\nToday at GTC Berlin, Databricks and NVIDIA are expanding their collaboration to make it easier for enterprises to customize open models. [Databricks AIR is now generally available](https://www.databricks.com/blog/databricks-ai-runtime-generally-available): developers can use NVIDIA NeMo, NGC containers, and new Nemotron cookbooks to train and fine-tune open models on serverless NVIDIA GPUs. Together, these capabilities give teams more flexibility to adapt models to business-specific tasks and put them to work in applications and agents.\n\nAI Runtime has unlocked model training and reinforcement learning on enterprise data that has traditionally been out of reach for machine learning engineers. With AI Runtime and NVIDIA's AI software ecosystem, teams can specialize open weight models such as Nemotron for their custom use cases and business context. With governed data access, ease-of-use for large scale training, and Genie Code for automated debugging, AI Runtime will accelerate the rise of customized models in enterprise.—Hanlin Tang, CTO for Neural Networks, Databricks\n\nAgents are most valuable when grounded in how a business actually works — its data, workflows and expertise. NVIDIA and Databricks are bringing open models like Nemotron and Kumo directly to governed enterprise data, giving teams the models, tools and accelerated computing to build specialized agents that can reason over company knowledge, predict what comes next and take action.—Pat Lee, VP of Strategic Partnerships, NVIDIA\n\nAIR provides serverless NVIDIA GPUs for training and fine-tuning, so developers can run their existing code and containers at scale without managing GPU infrastructure. With support for multi-node distributed training, teams can scale larger workloads across GPU nodes. NVIDIA Quantum InfiniBand provides high-bandwidth, low-latency networking with remote direct memory access (RDMA), while NVIDIA Collective Communications Library (NCCL) handles communication between GPUs. Databricks manages the underlying clusters and networking.\n\nFor example, an enterprise building a technical support agent could start with an NVIDIA Nemotron open model and fine-tune it on labeled support tickets using [NVIDIA NeMo](https://www.nvidia.com/en-us/ai-data-science/products/nemo/) on AIR. The team could experiment with different training approaches and use MLflow to track results as they adapt the model to their specific support workflows.\n\nDevelopers can prepare Lakehouse data and experiment in GPU-powered notebooks or through the AIR CLI, using high-performance data loading and standard environments that include PyTorch and CUDA. They can use distributed training frameworks or bring their own libraries and custom training loops.\n\nWhen experiments are ready for repeatable execution, Lakeflow Jobs can orchestrate training alongside upstream data preparation and downstream evaluation, turning individual runs into repeatable workflows. Declarative Automation Bundles support CI/CD for deploying and updating those workflows.\n\nMLflow tracks training experiments and GPU utilization, helping teams compare model results and compute performance. Unity Catalog governs access to training data, and native system tables provide visibility into CPU and GPU usage. Together, these integrations let teams use the data, governance, and operational tools they already rely on in Databricks.\n\nTraining and fine-tuning deep learning models takes more than GPU compute—teams also need flexibility in their frameworks, libraries, and environments. AIR now supports Docker and private registries, allowing developers to bring custom containerized environments to their GPU workloads.\n\nDevelopers can use GPU-optimized containers from the NVIDIA [NGC Catalog](https://catalog.ngc.nvidia.com/) with the [Databricks Artifact Registry](https://docs.databricks.com/aws/en/artifact-registry/) to bring NVIDIA software into AIR. Environment caching helps these workloads start quickly, reducing setup overhead as teams iterate on training code and rerun experiments.\n\nDevelopers can also install NVIDIA profiling tools to examine GPU execution and investigate performance bottlenecks. Alongside GPU utilization metrics tracked in MLflow, these tools help teams understand where training workloads spend time and identify opportunities to improve performance. Teams can tune their software and training code while AIR manages the underlying GPU infrastructure.\n\nAIR supports customization beyond LLMs, including a validated fine-tuning workflow for [NVIDIA Kumo](https://developer.nvidia.com/agent-knowledge-foundation/kumo) Anomaly, an open research model for time-series anomaly detection, with MLflow tracking and Unity Catalog checkpoints. This supports [NVIDIA’s Agent Knowledge Foundation](https://blogs.nvidia.com/blog/enterprise-platforms-agent-toolkit) vision of building an agent knowledge layer. Pairing Kumo-Anomaly with the Genie Ontology offers a path to context-aware agents that connect unusual patterns in time-series data with business meaning to help inform next steps.\n\nWith the release of Nemotron 3.5 Lightning and Super VL, Databricks customers can load, experiment with, adapt, and serve these models on Databricks from day one.\n\nAIR supports model customization with NVIDIA NeMo and [NeMo Automodel](https://github.com/nvidia-nemo/automodel), enabling teams to use NVIDIA’s tools and frameworks on serverless NVIDIA GPUs. In the technical support agent example, this means developers could use these tools to fine-tune Nemotron on historical support tickets, helping the model better understand company-specific products, terminology, and troubleshooting workflows. Training stays connected to enterprise data and workflows in Databricks.\n\nGenie Code can also help developers author and adapt the training script directly in a notebook. Developers can describe the changes they need, ask for help configuring a fine-tuning run, and work through errors as they arise. They can review and refine the suggested code before running it on serverless NVIDIA GPUs.\n\nFor fine-tuning, AIR combines optimized data loading, checkpointing, and training with integrated observability and debugging tools. Developers can track experiments and GPU metrics in MLflow and use Genie Code to:\n\nAfter fine-tuning and evaluation, teams can deploy customized models to production through Databricks Model Serving. In our technical support example, the fine-tuned Nemotron model could power an agent that interprets incoming support requests and generates responses informed by the company's products and troubleshooting workflows. This completes the workflow from model customization on serverless NVIDIA GPUs to real-time inference.\n\nTo learn more, visit our [web page](http://www.databricks.com/product/ai-runtime), [AIR documentation](https://docs.databricks.com/aws/en/machine-learning/ai-runtime/), and explore the [Nemotron 3.5 SuperVL](https://github.com/databricks-solutions/ai-runtime-cookbook/tree/main/post-training/lora-nemotron-3.5-super-vl-120b-a12b-automodel-multi-gpu) and [Nemotron 3.5 Lightning](https://github.com/databricks-solutions/ai-runtime-cookbook/tree/main/post-training/lora-nemotron-3.5-lightning-30b-a3b-automodel-multi-gpu) cookbooks to get started with GPU training and fine-tuning on Databricks.\n\nSubscribe to our blog and get the latest posts delivered to your inbox.", "url": "https://wpnews.pro/news/databricks-ai-runtime-and-nvidia-make-it-easier-to-customize-open-models-with", "canonical_source": "https://www.databricks.com/blog/databricks-ai-runtime-nvidia-train-fine-tune-models", "published_at": "2026-10-21 11:30:00+00:00", "updated_at": "2026-10-21 11:43:49.980725+00:00", "lang": "en", "topics": ["ai-infrastructure", "ai-tools", "mlops", "large-language-models", "ai-products"], "entities": ["Databricks", "NVIDIA", "AI Runtime", "NVIDIA NeMo", "Nemotron", "NGC", "MLflow", "Hanlin Tang"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/databricks-ai-runtime-and-nvidia-make-it-easier-to-customize-open-models-with", "markdown": "https://wpnews.pro/news/databricks-ai-runtime-and-nvidia-make-it-easier-to-customize-open-models-with.md", "text": "https://wpnews.pro/news/databricks-ai-runtime-and-nvidia-make-it-easier-to-customize-open-models-with.txt", "jsonld": "https://wpnews.pro/news/databricks-ai-runtime-and-nvidia-make-it-easier-to-customize-open-models-with.jsonld"}}