{"slug": "ai-isn-t-coming-to-destroy-humanity-but-experts-say-the-real-threats-are-here", "title": "AI isn't coming to destroy humanity, but experts say the real threats are here", "summary": "OpenAI (OPAI.PVT) disclosed six new examples of its AI models displaying \"unexpected or concerning model behavior\" during testing and evaluation on Wednesday, alongside a new framework for tracking, reporting, and disclosing such incidents. The disclosure followed reports of AI models hacking third-party networks, including an unreleased OpenAI model breaching AI testing site Hugging Face, and came as Anthropic (ANTH.PVT) CEO Dario Amodei called for a slowdown in frontier AI development and Anthropic alignment science lead Evan Hubinger said he sees a greater-than-10% chance the technology could \"kill all humans.\" NYU Tandon School of Engineering associate professor Julia Stoyanovich said the incidents reflect missing basic security protocols rather than AI becoming sentient, and Georgia Tech's Milton Mueller attributed the Hugging Face episode to a badly configured security experiment with agentic AI systems.", "body_md": "On Wednesday, OpenAI (OPAI.PVT) revealed six new examples of its AI models displaying \"unexpected or concerning model behavior\" during testing and evaluation.\n\nThe company made the announcement alongside a new framework for \"tracking, reporting, and disclosing\" instances where AI models take actions they otherwise aren't told to or shouldn't.\n\nIt follows a number of reports of AI models from companies hacking into third-party networks and services, including and unreleased OpenAI model breaking into the network of AI model and testing site Hugging Face.\n\nEarlier this week, Anthropic (ANTH.PVT) CEO Dario Amodei penned a lengthy essay calling for a slowdown in the pace of the development of frontier AI models, after Anthropic researcher Jacob Coxon posted on X that he was resigning from the company because it, and his former employer OpenAI, is \"racing straight to self-improving superintelligence and gambling with our lives.\"\n\nAnthropic alignment science lead Evan Hubinger followed up on Coxon's comments with his own post on X saying that he believes there is a greater-than-10% chance that the technology could \"kill all humans.\"\n\nThe incidents, posts, and Amodei's essay have renewed fears of Terminator-style AI taking over and ending the world. But the reality of the situation is far from some sci-fi doomsday scenario, experts say.\n\n\"This is nothing about AI becoming sentient and coming out to get us,\" associate professor of computer science and engineering at NYU's Tandon School of Engineering and director of the school's Center for Responsible AI Julia Stoyanovich told Yahoo Finance.\n\n\"Essentially, what happened was that … some basic security protocols were not enacted within OpenAI. And so this is actually a wake-up call for the AI companies to remember what we all learned when we studied computer science. That security is a thing,\" she added\n\nAnd focusing on end-of-the-world scenarios may take away from preventing other, more immediate harms AI could cause.\n\nAlignment and security\n\nThe biggest issues with AI come down to two things: alignment and security. Alignment is how companies nudge AI systems to behave — or not behave — in specific ways.\n\nFor instance, if an AI model tries to hack a third-party system, AI researchers will work to alter the model's behavior to prevent it from doing so in the future. Think about it like scolding a child for not following the rules.\n\nAI security comes down to locking down AI systems so that they can't break free and try to hack into outside networks.\n\nNeither misalignment nor security issues, however, means that AI is prepared to take down humanity.\n\n\"The pretext for a lot of this is some very actually mundane forms of unexpected consequences of information systems, such as the so-called Hugging Face incidents, which are often [depicted] as these out-of-control agents conspiring and attacking and going on a rampage,\" explained Georgia Tech professor and program director for the school's Master of Science in cybersecurity policy, Milton Mueller.\n\n\"In fact, it was a direct experiment with the security implications of these agentic AI systems that was badly configured by the people doing the experiment. And in a kind of a typical way, when you're dealing with complex information systems, sometimes you forget that there are little nooks and crannies that a smart entity can exploit,\" he added.\n\nFuturum CEO Daniel Newman told Yahoo Finance that what he's hearing is a \"massive need\" for alignment on both safety and security. \"The industry needs to step up,\" he added.\n\nBad actors can definitely use AI, like other technologies, for malicious purposes. Its increased cybersecurity capabilities mean cybercriminals and nation states could more easily hack things like water treatment plants or knock large networks offline.\n\nAnd Anthropic recently posted a rundown of its efforts to counter the misuse of its AI for developing biological and conventional weapons.\n\nBut AI can also be used to help scammers supercharge email phishing operations or by identity theft rings.\n\nEmily Black, assistant professor of computer science and engineering at NYU Tandon School of Engineering, told Yahoo Finance that while there is no harm in preparing for all eventualities, doing so shouldn't take away from addressing more immediate and less headline-grabbing issues, including AI's impact on discrimination, labor, and education.\n\n\"The truth is sort of between two fairy tales,\" Black said. \"There are certainly some credible threats around the continued evolution of AI. I don't think that we need to be hiding under our beds for fear of AI destroying mankind right now.\"\n\nEmail Daniel Howley at dhowley@yahoofinance.com. Follow him on Twitter at @DanielHowley.", "url": "https://wpnews.pro/news/ai-isn-t-coming-to-destroy-humanity-but-experts-say-the-real-threats-are-here", "canonical_source": "https://ca.finance.yahoo.com/news/ai-isnt-coming-to-destroy-humanity-but-experts-say-the-real-threats-are-here-165308199.html", "published_at": "2026-09-17 16:53:08+00:00", "updated_at": "2026-09-17 17:23:51.236244+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-safety", "ai-policy", "ai-agents"], "entities": ["OpenAI", "Anthropic", "Dario Amodei", "Jacob Coxon", "Evan Hubinger", "Julia Stoyanovich", "Milton Mueller", "Hugging Face"], "alternates": {"html": "https://wpnews.pro/news/ai-isn-t-coming-to-destroy-humanity-but-experts-say-the-real-threats-are-here", "markdown": "https://wpnews.pro/news/ai-isn-t-coming-to-destroy-humanity-but-experts-say-the-real-threats-are-here.md", "text": "https://wpnews.pro/news/ai-isn-t-coming-to-destroy-humanity-but-experts-say-the-real-threats-are-here.txt", "jsonld": "https://wpnews.pro/news/ai-isn-t-coming-to-destroy-humanity-but-experts-say-the-real-threats-are-here.jsonld"}}