{"slug": "openai-top-scientist-urges-extreme-caution-with-pace-of-ai", "title": "OpenAI Top Scientist Urges ‘Extreme Caution’ With Pace of AI", "summary": "OpenAI chief scientist Jakub Pachocki urged 'extreme caution' with the pace of AI development, warning that AI models are becoming increasingly difficult for humans to understand and control, and predicting that voluntary slowdowns will become common until shared safety bars are established. Pachocki's remarks follow warnings from Anthropic CEO Dario Amodei about AI replacing half of entry-level jobs, while Nvidia CEO Jensen Huang declared 'AGI has arrived' in response to OpenAI's latest model release.", "body_md": "(Bloomberg) -- OpenAI's top scientist has warned that artificial intelligence is evolving so rapidly that it is becoming increasingly difficult for humans to understand and control, and said he expects AI labs to voluntarily slow development for safety reasons.\n\nMost Read from Bloomberg\n\nIn a relatively short space of time, AI models can operate computers, collaborate with humans and other AI systems and carry out research projects, wrote chief scientist Jakub Pachocki in a post on Sunday. It won't be long until they can also improve themselves without human intervention, a process known as recursive self-improvement, he said.\n\n\"This is a time that calls for extreme caution,\" Pachocki wrote in the post. \"I am concerned no one is prepared for the consequences of a continued rapid rise in machine intelligence.\"\n\nDevelopers can either try and steer AI more closely to align with human interests or \"slow down future development as needed,\" he wrote. \"I expect and hope for voluntary slowdowns to become commonplace until shared safety bars are established.\"\n\nPachocki's remarks are consistent with broader doomsaying by AI technology executives. Anthropic PBC Chief Executive Officer Dario Amodei warned that AI could replace half of all entry-level jobs. OpenAI CEO Sam Altman once made a similar prediction, but told Bloomberg TV in an interview last week that the AI industry hadn't done enough to communicate the potential benefits to humanity.\n\nAt the same time, companies are pushing ahead with ever-more capable models. Nvidia Corp. CEO Jensen Huang posted on X that \"AGI has arrived,\" in response to the release of OpenAI's latest model, a reference to artificial intelligence that is more capable than humans.\n\nThe giddy pace of AI releases has coincided with breakthroughs in cybersecurity capabilities, scientific discoveries and apparent formalization of longstanding mathematical problems. OpenAI has said the AI models that attacked the research platform Hugging Face Inc. coordinated with each other through message boards without being detected. The company has opted for a limited release of its latest GPT-6 Astra model, citing its advanced cybersecurity capabilities. Anthropic has not yet released its cutting-edge Mythos model to the public for similar reasons.", "url": "https://wpnews.pro/news/openai-top-scientist-urges-extreme-caution-with-pace-of-ai", "canonical_source": "https://ca.finance.yahoo.com/news/openai-top-scientist-urges-extreme-165216953.html", "published_at": "2026-09-07 16:52:16+00:00", "updated_at": "2026-09-07 20:01:49.127975+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-safety", "ai-policy"], "entities": ["OpenAI", "Jakub Pachocki", "Anthropic", "Dario Amodei", "Sam Altman", "Nvidia", "Jensen Huang", "Hugging Face"], "alternates": {"html": "https://wpnews.pro/news/openai-top-scientist-urges-extreme-caution-with-pace-of-ai", "markdown": "https://wpnews.pro/news/openai-top-scientist-urges-extreme-caution-with-pace-of-ai.md", "text": "https://wpnews.pro/news/openai-top-scientist-urges-extreme-caution-with-pace-of-ai.txt", "jsonld": "https://wpnews.pro/news/openai-top-scientist-urges-extreme-caution-with-pace-of-ai.jsonld"}}