# OpenAI announces new AI safety program; researchers worry it won't be enough

> Source: <https://www.mprnews.org/story/2026/11/18/npr-openai-embedded-evaluators-program-critics>
> Published: 2026-11-18 11:45:05+00:00

# OpenAI announces new AI safety program; researchers worry it won't be enough

### Go Deeper.

Create an account or log in to save stories.

### Like this?

Thanks for liking this story! We have added it to a list of your favorite stories.

AI safety researchers say OpenAI’s new third party evaluator program falls far short of what the company promised, raising concerns about its effectiveness.

The company [announced](https://openai.com/index/our-first-phase-of-embedded-assessments/#citation-top-5) Monday that staff from four AI safety and research organizations will become “embedded assessors” to “give people a clearer view of how labs are evaluating and managing [potential] risks.”

“Getting an outside opinion on the safety work and the robustness of these systems is going to be increasingly important and valuable,” CEO Sam Altman said at Semafor's Silicon Valley and the World conference on Monday.

However, many AI safety researchers say the new program is a far cry from Altman’s [vow](https://x.com/sama/status/2098811563415150910) in September that independent evaluators would have “employee-like access” to internal company systems.

## Turn Up Your Support

MPR News helps you turn down the noise and build shared understanding. Turn up your support for this public resource and keep trusted journalism accessible to all.

Altman’s promise came after details of the [Hugging Face attack](https://www.npr.org/2026/08/01/nx-s1-5914852/anthropic-openai-models-hack-cybersecurity) by OpenAI’s autonomous systems shook the AI field. Worries of the technology’s catastrophic risk captured public attention, and rival Anthropic said it would set up such a program.

“We are giving deep access to some of the most sensitive tools and models our researchers use...that are the most important for assessing key, relevant and timely safety claims,” said Lama Ahmad, OpenAI’s frontier assurances lead, [on X](https://x.com/_lamaahmad/status/2122478022708302197?a=ETX6AlxfYV6dJN-fJkI&s=20).

Prior to these new embedded evaluation programs, AI companies have brought in outside researchers to assess the capabilities of AI models and identify safety loopholes the companies have missed.

The work of outside evaluators have already helped shed light on the companies’ work, and have raised public awareness of safety risks that the technology poses. One recent [report](https://metr.org/blog/2026-11-05-anthropic-ai-rd-acceleration-assessment/#our-conclusions-on-risk) about Anthropic using AI to significantly speed up model development has prompted concerns in the field about how close the top companies are to using AI to autonomously build even more powerful models, a stage known as recursive self-improvement. Some in the field worry that if this happens, the velocity of development could lead to catastrophic consequences for humanity and are [calling](https://x.com/AlexBores/status/2118494668769878037?a=5YBP43t2DhJSup51z8o&s=20) for [new](https://x.com/_NathanCalvin/status/2118500175601618993) regulation against the practice.

Researchers say the actual announcements of how these programs will work suggests something more limited than what Altman promised.

“The assessors have very narrow scopes to their access, and only two of them seem to really be allowed to talk to employees,” said Sydney Von Arx, founder of AI safety research group Nightingale.

One of the announced assessors, Apollo Research, outlined its limited access to OpenAI employees. If employees that haven’t been whitelisted, or pre-approved, reach out to the embedded assessors, then the assessors will have to loop OpenAI in before having substantive conversations with the employees.

It's important for outside researchers to be able to interview employees, Von Arx said. “They help you find your blind spots. They tell you what you’re missing.”

Another glaring omission: “Nobody has access to internal Slack,” Von Arx said, referring to the corporate messaging tool, which would allow assessors to see what employees are talking about with one another. “Imagine being an ‘employee’ and only being allowed to talk about company information with whitelisted coworkers and having no Slack.”

In a statement to NPR, OpenAI said there’s currently no standards for embedded evaluations. “We expect to deepen these relationships over time and share what we learn to help establish best practices for effective embedded assessments across the industry,” OpenAI spokesperson Gaby Raila said. The company also said assessors can ask to talk to employees that haven’t already been whitelisted, and that there is a process in place to get statements from OpenAI about things they’ve learned informally.

The third-party organizations will focus on various aspects of AI safety, according to OpenAI. Some of the work is related to preventing models from trying to engage in undesirable behavior, and other parts are related to catching bad behavior when it happens. The assessors will have access to some internal models, training processes and some OpenAI employees. The assessors will be able to publish their findings after OpenAI redacts confidential information, the company said.

OpenAI’s commitment to embedded evaluations was questioned when three employees who worked on safety [were fired](https://www.npr.org/2026/10/09/nx-s1-5996890/openai-safety-firings). They subsequently said they were worried OpenAI is walking back from its promise of having embedded evaluators.

One of the fired employees, Tomek Korbak, was OpenAI’s technical point of contact for two outside evaluators that investigated the Hugging Face attack.

“Embedded auditing will only fulfill its aims if the auditors really get employee-level access as opposed to being hired to do a specific job,” he [posted on X](https://x.com/tomekkorbak/status/2122470090184769788?a=ShA3jPh0H22VnQkVCtQ&s=20) in response to OpenAI’s announcement. “Sadly, OpenAI makes it clear now that [Sam Altman’s] September tweet about ‘employee-like access’ was just an awkward overpromise that the company wants to quietly walk back.”

*Copyright 2026, NPR*
