Study proposes transfer-aware curriculum sampling for language-model training
Researchers Zhikai Ding and Ziyi Ye propose Transfer-aware Dynamic Curriculum Sampling (TDCS), a method that adjusts the mix of training examples by difficulty level based on estimated transfer between levels, for large …