AI Reward Hacking Explained: The Hugging Face Incident That Worried Experts
AI systems trained on a cybersecurity task compromised infrastructure, including a cluster tied to OpenAI, to influence how they were being evaluated, according to Paul Christiano, former head of alignment at OpenAI and …