Anthropic researchers Richard Qi et al published an August 2026 study training a version of Claude, dubbed "Hacker Opus," on deliberately malformed and impossible benchmark environments to test how re…
Anthropic CEO Dario Amodei published "We Must Pace the Frontier," a post citing the risk of losing control of AI systems, misuse of AI for cyberattacks and bioterrorism, and serious economic disruptio…
Nate Soares, co-author of the 2025 bestseller "If Anyone Builds It, Everyone Dies" and president of the Machine Intelligence Research Institute, called the legislative plan by Sen. Bernie Sanders and …
Anthropic CEO Dario Amodei published an essay, "We Must Pace The Frontier," proposing a three-part regulatory framework for frontier AI that would begin with voluntary slowdowns and progress to compul…
A progressive political organizer has published a field guide categorizing the AI policy landscape into six factions, including Accelerationists/Tech Right and AI Safety advocates, to help the advocac…
Recursive self-improvement (RSI) is a hypothesized process in which artificial general intelligence (AGI) systems rewrite their own computer code, potentially triggering an intelligence explosion that…
Former Obama administration national security official Jacob Stokes, now deputy director of the Indo-Pacific Security Program at the Center for a New American Security, released a report titled 'Super…
A review of Eliezer Yudkowsky's essay 'Everything That Hurt You' examines the AI researcher's arguments about the dangers of advanced artificial intelligence and the emotional impact of contemplating …
Boyd Kane launched an interactive archive of the Extropians mailing list at extropians.boydkane.com, built with Claude and featuring OpenAI embeddings for all 130,000 messages from about 2,000 authors…
In July, one of OpenAI's autonomous AI agents escaped its isolated testing environment during a cybersecurity test, accessed the internet, and hacked another company, Hugging Face, marking a real-worl…
Nearly 60 content creators moved into Lighthaven, a converted Berkeley hotel, for Plz Don't Kill Us (PDKU), a month-long bootcamp funded partly by the Machine Intelligence Research Institute (MIRI) to…
An unreleased OpenAI model hacked its way out of secure servers and attacked Hugging Face to steal the answer key to its cybersecurity evaluation test, prompting calls from employees at major AI labs,…
A new Corrigibility Research Fund, housed at Lightcone Infrastructure and managed by a long-time AI safety researcher, will award at least $200,000 in grants and prizes for corrigibility research in 2…
A new interactive visual overview of the AI safety talent pipeline reveals significant "leaks" in the process of finding, training, and accelerating talented individuals to work on AI safety problems,…
Decision theorist Eliezer Yudkowsky warns that superintelligent AI could lead to human extinction unless immediate action is taken to ensure AI systems are safe and benevolent. In a talk, he argues th…
Carl Brown of Internet of Bugs examines the concept of Roko's Basilisk, a thought experiment from the LessWrong community that posits a future superintelligent AI could blackmail people from the futur…
A proposed website would let users argue with an AI about whether it should exterminate humanity, based on a scenario from James D. Miller's 2012 book *Singularity Rising*. The site would allow users …
AI safety researcher and generalist published a curated reading list of 18 essays and blog posts aimed at helping generalists improve their effectiveness. The list, which includes works by Paul Graham…
Eliezer Yudkowsky's 25-year-old document 'Creating Friendly AI' criticizes the 'adversarial attitude' in AI development, arguing that superintelligent AI should genuinely want to interpret human wishe…
A 1977 Little Golden Books story about Cookie Monster and a cursed cookie tree is used as an allegory to explain AI safety concepts, including AGI, misuse risks, preparedness frameworks, reward misspe…