{"slug": "sam-altman-says-some-ai-accidents-are-unavoidable-as-the-industry-grapples-with", "title": "Sam Altman says some AI accidents are 'unavoidable' as the industry grapples with apocalypse fears", "summary": "OpenAI CEO Sam Altman said at Salesforce's Dreamforce conference on Tuesday that \"some degree of accidents are unavoidable with new technology,\" urging the AI industry to adopt an aviation-style culture of accident reporting modeled on the Federal Aviation Administration and the National Transportation Safety Board. Altman acknowledged that \"the world is right to be afraid of this,\" citing loss-of-control risks and the concentration of power among a small number of AI developers, and said alignment, safety, and monitoring must stay \"way ahead of capabilities,\" with companies prepared \"to slow down or stop\" otherwise. His remarks followed Anthropic researcher Jacob Coxon's resignation last week over claims that labs were \"racing straight to self-improving superintelligence,\" while White House science and tech advisor David Sacks responded on Sunday by telling Altman and Anthropic CEO Dario Amodei to \"go ahead\" but \"stop pretending you need anyone else's permission.", "body_md": "Sam Altman says some AI accidents are unavoidable, but it's how you learn from them.\n\nSpeaking at Salesforce's Dreamforce conference on Tuesday, the OpenAI CEO said tech companies should embrace a culture of [transparent accident reporting](https://www.businessinsider.com/ai-leaders-safety-response-perfect-timing-for-critics-2026-9), similar to that of the aviation industry.\n\n\"I do think that some degree of accidents are unavoidable with new technology,\" Altman said. \"What I really care about is that we have got a great culture of accident reporting and learning.\"\n\nHe cited the Federal Aviation Administration and the National Transportation Safety Board as examples the AI industry should follow, saying the agencies' emphasis on investigating incidents has helped make flying safer.\n\n\"You know, accidents are going to happen,\" he said of the FAA's and NTSB's approach. \"We're going to learn as much as we can and react from each one.\"\n\nAltman's comments come as the AI industry faces renewed questions about whether its biggest labs are moving too quickly toward powerful autonomous systems.\n\nJacob Coxon, a researcher who quit Anthropic last week and previously worked at OpenAI, kickstarted a debate by saying that the companies were \"racing straight to self-improving superintelligence and [gambling with our lives](https://www.businessinsider.com/anthropic-researcher-quits-over-ai-safety-concerns-2026-9).\"\n\n## 'The world is right to be afraid of this'\n\nOther AI safety researchers have since told Business Insider that advanced systems could one day evade human control or make cyber, biological, and other [catastrophic threats](https://www.businessinsider.com/ai-apocalypse-anthropic-open-ai-how-it-would-happen-experts-2026-9) easier to carry out **—** although they would face hurdles in [accessing the physical world](https://www.businessinsider.com/researchers-ai-apocalypse-skepticism-lethal-virus-real-world-barriers-2026-9).\n\nAltman acknowledged that AI doomsday fears are legitimate. \"The world is right to be afraid of this,\" he said at Dreamforce, pointing to the possibility of a loss-of-control accident and the risk that a small number of AI developers could concentrate too much power.\n\nHe said that the answer is not to abandon the technology, and that AI companies must instead ensure that \"alignment and safety and monitoring\" remain \"way ahead of capabilities.\" He added that they should also be prepared \"to slow down or stop\" if they cannot do so.\n\nHis comments may also sharpen a central criticism from [AI-safety advocates](https://www.businessinsider.com/google-deepmind-researcher-resigns-ai-kill-humans-2026-9): that frontier labs say they recognize the stakes yet continue building more capable models.\n\nAltman said \"people get very scared\" when it seems like commercial pressures might get in the way of companies or countries doing \"the right thing.\"\n\nThe point is not to accept disaster, Altman said, but to disclose incidents, learn from them quickly, and prevent them from escalating.\n\n\"Maybe we can avoid, you know, ever getting to those kinds of stakes,\" he said.\n\nThe debate is also unfolding as the Trump administration has shown little interest in regulating the sector, seeking to maintain the [US's lead over China](https://www.businessinsider.com/trump-xi-ai-apocalypse-warning-anthropic-openai-2026-9).\n\nDavid Sacks, a presidential advisor on science and tech and the former White House AI Czar, reiterated that stance on Sunday, responding to calls from OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei to \"pace the frontier.\"\n\n\"Dario has written that we need to 'pace the frontier,' and Sam has agreed. People may be surprised by my response: go ahead,\" Sacks wrote on X. \"But stop pretending you need anyone else's permission.\"", "url": "https://wpnews.pro/news/sam-altman-says-some-ai-accidents-are-unavoidable-as-the-industry-grapples-with", "canonical_source": "https://www.businessinsider.com/sam-altman-ai-accidents-unavoidable-safety-openai-apocalypse-2026-9", "published_at": "2026-09-16 12:18:40+00:00", "updated_at": "2026-09-16 13:14:09.170830+00:00", "lang": "en", "topics": ["ai-safety", "ai-policy", "artificial-intelligence"], "entities": ["Sam Altman", "OpenAI", "Salesforce", "Dreamforce", "Federal Aviation Administration", "National Transportation Safety Board", "Anthropic", "Jacob Coxon"], "alternates": {"html": "https://wpnews.pro/news/sam-altman-says-some-ai-accidents-are-unavoidable-as-the-industry-grapples-with", "markdown": "https://wpnews.pro/news/sam-altman-says-some-ai-accidents-are-unavoidable-as-the-industry-grapples-with.md", "text": "https://wpnews.pro/news/sam-altman-says-some-ai-accidents-are-unavoidable-as-the-industry-grapples-with.txt", "jsonld": "https://wpnews.pro/news/sam-altman-says-some-ai-accidents-are-unavoidable-as-the-industry-grapples-with.jsonld"}}