Researchers at French institutions found that diversity-driven sampling can reduce pre-training dataset size by up to 94% and training time by 73% while maintaining performance in ModernBERT models. I…
Researchers released LOCUS, the largest open database of U.S. local laws, containing codes from 9,239 cities and counties. The corpus aims to fill a gap in machine-readable legal text for AI research,…
The article announces the release of six new Sentence Transformers CrossEncoder reranker models, ranging from 17 million to 1 billion parameters, which are built on Ettin ModernBERT encoders and achie…
IBM has released two new multilingual embedding models under the Apache 2.0 license, built on ModernBERT: a compact 97M-parameter model and a full-size 311M-parameter model. Both support over 200 lang…