Task-Seeded Synthetic QA Data Generation for Nemotron Pretraining
NVIDIA built a five-stage "Task-Seeded SDG" pipeline for its Nemotron model family, drawing roughly 70 public tasks and about 700 subtasks from lm-eval-harness to generate synthetic QA pairs that matc…