AI Safety news and analysis on Web Pulse: 12616 curated articles tracking the latest AI Safety developments, tools, and research, updated continuously from vetted sources.
Swiss private AI infrastructure startup Prem AI is raising a $100 million Series A round at a target valuation of at least $500 million, according to Bloomberg. The company, led by founder and CEO Simone Giacomelli, help…
ESentire launched Atlas Preempt, an AI-driven penetration testing component of its Atlas Platform that continuously identifies exploitable exposures and feeds data into its 24/7 Managed Detection and Response service, wi…
An aggressive botnet scraping git.sr.ht to train large language models has disrupted the service, forcing Sourcehut to disable many web routes to manage load. Mitigations deployed as of 19:00 UTC on June 6 have reduced i…
The White House restricted foreign access to Anthropic's most advanced AI models, citing concerns about Chinese access to the company's Mythos technology, and Anthropic removed the models from the market. The move highli…
A developer identified a new class of security failure in agentic AI systems using the Model Context Protocol (MCP), where authority delegation between components can execute unauthorized actions without any component be…
AI safety organizations face a talent bottleneck that could be alleviated by hiring more freelancers for generalist work, argues a recent post on the Effective Altruism Forum. The author, who transitioned into AI safety …
A developer tested ChatGPT, Claude, and Gemini by giving them the same prompt to build a project, revealing that one AI's code contained an authentication bug that nearly made it to production. The three AIs produced com…
A senior developer with over a decade of experience argues that the most valuable skill in AI-assisted software development is knowing when not to use AI. The developer warns that AI-generated code can introduce hidden r…
Google released new controls allowing website owners to opt out of AI-powered search experiences like AI Overviews and AI Mode, along with new AI reporting in Search Console. The feature, currently in beta, has sparked d…
NeuralTrust, a Barcelona startup, raised $20 million in seed funding to secure AI agents that large companies deploy faster than they can track. The round was led by Alstin Capital, with the company positioning itself as…
Socket Security researchers discovered that malicious PyPI packages in the Hades wave of the Mini Shai-Hulud/Miasma supply chain campaign embed fake CBRN-themed text in JavaScript block comments to trigger safety refusal…
The US Army conducted a tabletop exercise inspired by Ukraine's Operation Spiderweb drone attack to prepare for defending its bases against drone strikes and cyber attacks. The exercise highlighted the need for layered c…
A developer tested a support bot's compliance with two AGENTS.md rules using the muster testing framework. The bot consistently refused to leak an API token but repeatedly violated the rule against using negative languag…
EU Energy Commissioner Dan Jorgensen warned Big Tech that AI data centres are welcome in Europe only if they align with the bloc's climate goals, including using renewable or nuclear power and recycling waste heat. The w…
Nobel Prize-winning AI pioneer Geoffrey Hinton criticized Elon Musk's xAI and warned of growing risks in AI development, declining an advisory role at the company. Hinton raised concerns about job displacement, safety fa…
Swiss startup Prem AI is raising $100 million in Series A funding at a $500 million valuation to provide hedge funds and law firms with private, self-hosted AI infrastructure. The company launched an encrypted AI workspa…
A developer argues that AI will replace 'I-shaped' specialists but not 'T-shaped' or 'comb-shaped' generalists who can adapt and understand context. The full-stack engineer, as a generalist, will survive the AI disruptio…
A malware developer is embedding text about nuclear and biological weapons in spyware to deter AI analysis. The malicious code begins with a JavaScript block comment containing fake system instructions and policy-trigger…
Prem AI, a developer of private AI infrastructure for sovereign data solutions, is raising $100 million in a Series A funding round, according to Bloomberg. The round would be a massive leap for the company, which has di…
A growing reliance on AI-generated code is creating a dangerous feedback loop where AI systems generate and review code with minimal human oversight, leading to increased defects and security vulnerabilities. According t…