A new paper argues that natural selection's inability to resolve small fitness differences due to noise can make evolution effectively non-myopic, enabling the emergence of "individuals" as coalitions…
A junior technical AI safety researcher should not attempt to write and publish their first research paper alone, as the chances of success are very low. Instead, the author recommends applying to par…
Researchers have improved Activation Oracles (AOs)—fine-tuned LLMs that answer natural language questions about a target model's internal activations—by training on on-policy rollouts, using a higher-…
A recent MATS research talk argued that the imminent automation of AI research, as predicted by OpenAI and Anthropic, could cause an unrecoverable alignment failure. The talk identified three dangerou…
A research manager at the ML Alignment & Theory Scholars (MATS) program shared advice for aspiring research managers and coaches after six months in the role, emphasizing that the position is fundamen…
Researchers introduced Blueprint-Petri, a pipeline that generates detailed environment blueprints for more realistic scheming propensity evaluations in AI models. In a case study auditing Gemini 3.1 P…