cd/entity/Dataset.from_generator()· home entities Dataset.from_generator()
grep -l @dataset.from_generator() /news/*.json | wc -l → 1

Dataset.from_generator()

mentions 1 type Organization feed RSS

// recent coverage 1 mentions

12:23
2026-08-26
discuss.huggingface.co
developer-tools

Save a dataset while it's being created by from_generator()

Hugging Face's datasets maintainer lhoestq confirmed there is no official way to resume an interrupted Dataset.from_generator() build, recommending instead to split work into multiple Dataset objects …

// co-occurs with top 3 entities
// topics top 1 topics