Ning Cao

Preference Model open-sourced Karotte, a framework it has used in production to build reinforcement learning environments for leading AI labs, hardened through more than a million evaluation runs and …