Build Training-Ready Physical AI Datasets with Two Prompts in NVIDIA Cosmos NVIDIA released the Cosmos Data Factory (CDF), an open collection of five cloud-native blueprints and six composable skills that lets developers build training-ready physical AI datasets with two prompts, the company said. The first prompt clones the CDF Orchestration repository and runs preflight and setup; the second runs a blueprint for one of five use cases, including autonomous vehicle scenario generation, image attribute augmentation, video augmentation across weather and lighting, rare event video generation, and defect image generation for visual inspection. NVIDIA said frontier AI agents can orchestrate the blueprints to enable prompt-to-data without human steering. World model https://www.nvidia.com/en-us/glossary/world-models/ accuracy starts with high-quality, diverse training datasets. Yet capturing rare defects, nighttime incidents, and other challenging scenarios is costly and time-consuming. Turning raw data into training-ready datasets adds complexity, particularly when using disconnected tools and manual processes for curation, labeling, generation, and evaluation. NVIDIA technology is helping developers more easily build high-quality, diverse training datasets at scale for physical AI https://www.nvidia.com/en-us/glossary/generative-physical-ai/ . NVIDIA Cosmos https://www.nvidia.com/en-us/ai/cosmos/ is an open platform of frontier models https://www.nvidia.com/en-us/glossary/frontier-models/ , datasets, frameworks, and skills for world model development. As part of this platform, NVIDIA Cosmos Data Factory CDF https://github.com/NVIDIA/cosmos-data-factory is a collection of five cloud-native blueprints and six composable skills to accelerate data curation, processing, and synthetic data generation SDG https://www.nvidia.com/en-us/use-cases/synthetic-data-physical-ai/ . Frontier AI agents https://www.nvidia.com/en-us/ai/ can be used to orchestrate these blueprints, enabling prompt-to-data without human steering. This post walks you through how to curate and augment datasets or create anomalous events for physical AI model training with just two prompts in Cosmos. It features five different use cases. Set up and configure Cosmos blueprints and skills: Prompt 1 Cosmos Data Factory contains five reference blueprints for common tasks. All five blueprints run using the CDF Orchestration core skill https://github.com/NVIDIA/cdf-orchestration , which coordinates workflow steps, deploys the required services, and manages execution on your cluster. To set it up, enter the following prompt into your coding agent: | Example prompt: “Clone the CDF Orchestration repository, then run orchestration preflight and setup.” | |---| Preflight checks your environment without making changes and flags anything missing. Once those checks pass, setup prepares your environment to run the blueprints. Run the blueprint for your training data use case: Prompt 2 This section features five training data use cases for running the blueprint, including example prompts: - Generate driving scenarios for autonomous vehicle AV training - Augment image attributes for search and re-identification - Augment videos across weather, lighting, and environments - Generate rare event videos for model training - Generate defect images for visual inspection If you already have footage or images and need to curate and add more variety, the first use case in this section covers generating driving scenarios, varying clothing attributes in person images, and transforming videos across weather, lighting, and environmental conditions. The augmentation use cases expand the variety in your existing data, but some training gaps call for creating entirely new events or defects. Your model might need to recognize a leaking product or a defective circuit board, but your dataset may contain few examples or none. Waiting to capture enough rare cases can take years, and staging them can be dangerous or expensive. The last two use cases cover generating rare event videos and defect images from images or 3D assets to fill these gaps. Use case 1: Generate driving scenarios for AV training The Autonomous Vehicle Dataset Generation blueprint https://github.com/NVIDIA/cdf-orchestration/blob/main/skills/cdf-autonomous-vehicle-dataset-generation/SKILL.md helps you search large databases of driving scenarios and generate novel datasets for downstream model training and validation tasks. NVIDIA Cosmos Curator https://github.com/NVIDIA/cosmos-curator extracts metadata for your video dataset inputs, and NVIDIA Cosmos Dataset Search https://github.com/NVIDIA-Omniverse-blueprints/cosmos-dataset-search finds relevant videos through those embeddings. The retrieved videos are passed to NVIDIA Cosmos3-Super-Image2Video style transfer, and Cosmos Evaluator https://github.com/NVIDIA/cosmos-evaluator checks the generated videos for physical plausibility. | Example prompt: “Search for driving scenes similar to our input video.mp4, transform them into rainy, snowy, and foggy while preserving layout and motion, and check physical plausibility.” | |---| Use case 2: Augment image attributes for search and re-identification The Image Attribute Augmentation reference blueprint https://github.com/NVIDIA/cdf-orchestration/blob/main/skills/cdf-image-attribute-augmentation/SKILL.md generates variations of person-crops with controlled attribute changes such as clothing type, accessories, and color. An LLM turns your selected attributes into structured modification prompts, used to generate the augmented variations of the source image. Cosmos Evaluator confirms that the requested clothing attributes appear. The blueprint then auto-labels the results with clothing attributes and search queries for person search and re-identification. | Example prompt: “Augment the person crops in