00:00
2026-06-22
aclanthology.org
large-language-models
A Diversity Diet for a Healthier Model: A Case Study of French ModernBERT
Researchers at French institutions found that diversity-driven sampling can reduce pre-training dataset size by up to 94% and training time by 73% while maintaining performance in ModernBERT models. I…