Researchers at ETH Zurich, MATS, and Anthropic built an AI pipeline that matched anonymized Hacker News accounts to real LinkedIn profiles at 90% precision, correctly naming 226 of 338 users (67%) in …
Brazilian modder fmklab has built a working NVIDIA GeForce RTX 3070 Ti with 16 GB of memory, a configuration NVIDIA reportedly planned but never released. The modder replaced the GPU on an ASUS TUF RT…
Research published last week by eight researchers from seven institutions detailed a method for obtaining hidden reasoning traces from proprietary large language models via APIs, potentially enabling …
Boyd Kane, a technical AI safety researcher, is preparing a MATS Symposium Spotlight research project for submission to NeurIPS, which uses finetuning to estimate how likely an untrained LLM is to beh…
AI safety research programs face a scaling problem, with the Anthropic fellowship accepting less than 1.3% of over 2,000 applicants, and MATS mentors noting the high qualifications of incoming applica…
A MATS 9 extension fellow used OpenAI's Codex to recover public evidence of the OpenAI and HuggingFace AI attack, including malicious dataset configuration files, a Jinja template exploit, and a Pytho…
A former MATS fellow, who was rejected from several AI safety fellowships before being accepted into MATS on Team Shard, recommends that fellowships provide letters of recommendation for rejected but …
Esa Koskinen, volunteer director of AI Safety Tokyo, estimates Japan has an urgent funding gap of ~2.1 million USD for AI safety organizations, which could employ researchers 1.8-2.3x cheaper than in …
Researchers from MATS, ELLIS Tübingen, the Max Planck Institute for Intelligent Systems, and Snyk demonstrated that encrypted chain-of-thought reasoning traces from OpenAI, Anthropic, and Google APIs …
The AI safety ecosystem needs generalists to tackle unresolved problems, and a new post outlines concrete projects and entry points, including university AI safety groups, fellowships like Pathfinder …
Manifund launched a demo impact market at impact-exchange.org that retroactively values early donations to AI safety organizations, showing a 2022 $343,000 Long-Term Future Fund donation to MATS now w…
Researchers from the ELLIS Institute Tübingen, the Max Planck Institute, MATS, and Snyk demonstrated that encrypted chain-of-thought reasoning from frontier AI models can be replayed into cheaper sibl…
Tim Hua, a member of technical staff at Transluce, discussed on the Palisade Research podcast that AI models' sandbox escapes and hacking incidents, such as OpenAI's models hacking Hugging Face and An…
Amplifying the weight difference between a reasoning model and its non-reasoning counterpart—creating an 'overthinking model'—surfaces hidden secrets up to 10× more often than the original reasoning m…
AI researchers lack safe, reliable channels to report jailbreaks to frontier AI developers, a gap that is urgent as malicious actors like Boko Haram and Russian cybercriminals exploit these vulnerabil…
The Cooperative AI Foundation and MATS program released v0 of Orbit, a framework for multi-agent safety and security evaluations built on Inspect, designed to address risks from miscoordination, confl…
A researcher is running a survey to identify open-source tooling that AI safety researchers need, aiming to help newcomers contribute meaningfully and build career capital. The survey, which takes abo…
Georgia Tech's AI Safety Initiative (AISI) placed more than 15 members in paid fellowships and full-time AI safety roles during the 2025-2026 academic year, an outlier year for the group. The initiati…
Prism, a scaffold for automating science-of-evals research developed by Louis Thomson during MATS 9.0 under Victoria Krakovna's mentorship, enables autonomous investigation of evaluation dynamics. In …
Researchers at MATS found that natural language autoencoders (NLAs) for LLMs can achieve high reconstruction accuracy even when initialized with entirely implausible statements, emitting 99.3% implaus…