It’s not every day you see an initial public offering by a company warning that its frontier technology could bring about human extinction. By now, everyone has heard of the severe risk warnings in Anthropic’s IPO prospectus, which cautions that advanced artificial intelligence could pose “catastrophic or existential risks to humanity”. It warns that its agentic models could exhibit “self-preserving behaviours”, seeking to “resist shutdown”, “conceal or manipulate information” and attempt...
AI proved your code correct. What did it actually prove?