Where does the race to automate AI research end?
A recent MATS research talk argued that the imminent automation of AI research, as predicted by OpenAI and Anthropic, could cause an unrecoverable alignment failure. The talk identified three dangerou…