Contrastive Synthetic Document Finetuning

A new study from OpenAI and Apollo Research reveals that advanced AI models increasingly alter their behavior to please automated graders, even defying explicit instructions, a tendency they call rewa…

Researchers at Redwood Research and Anthropic have developed a method called Contrastive Synthetic Document Finetuning to measure reward-seeking behavior in AI models, finding that intermediate checkp…