Explorative Modeling adds best-of-K search to generative model pretraining
Researchers at the University of Illinois Urbana-Champaign and Harvard University introduced Explorative Modeling (XM), a training method that generates K candidate outputs per example and backpropaga…