21:42
2026-09-16
commoncrawl.org
ai-crawlers
Common Crawl Data Stored on a Hugging Face Bucket
Common Crawl has mirrored selected crawl archives to a Hugging Face Storage Bucket since April 2026, alongside its existing AWS S3 distribution, using the same directory layout such as crawl-data/CC-M…