Explorative Modeling

A 115.7M-parameter masked diffusion language model trained with Explorative Modeling (XM) at K=3 for 10,000 steps on one RTX 4090 matched the compute of a 20,000-step baseline but showed a 0.19 nats h…

Researchers introduced Explorative Modeling (XM), a new generative modeling paradigm that improves existing models across images, video, and language by adding exploration as a third pretraining axis.…

Researchers at the University of Illinois Urbana-Champaign and Harvard University introduced Explorative Modeling (XM), a training method that generates K candidate outputs per example and backpropaga…