01:44
2026-10-16
huggingface.co
artificial-intelligence
Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline
NVIDIA and IIT Madras' AI4Bharat lab are releasing Nemotron-pretraining-Indic-v1, a corpus of approximately 2.8 trillion tokens covering the 22 languages listed in India's Constitution, alongside an o…