cd /news/ai-safety/the-real-test-of-openais-audits-is-d… · home › topics › ai-safety › article
[ARTICLE · art-171268] src=thedeepview.com ↗ pub= topic=ai-safety verified=true sentiment=· neutral

The real test of OpenAI’s audits is disclosure

OpenAI announced on Monday that it has signed agreements with four third-party auditors — Apollo Research, METR, Transluce and Goodfire — to embed assessors across its operations with access to model checkpoints, source code, data, monitoring systems and technical documentation, as the first phase of its embedded assessments. The initial evaluations focus on alignment and safeguards in training and internal use: Apollo Research will test whether models can covertly work against a user's intentions, METR will probe misaligned behavior in what OpenAI calls its "largest reinforcement learning run to date" plus a red-teaming stress test, Transluce will run post-training alignment evaluations on selected public and unreleased models, and Goodfire will handle training run monitoring, debugging and alignment. OpenAI said it will publicly report some findings but retains "the right to redact confidential information" and to request "responsible disclosure delays," a limit the story argues undercuts the accountability that independent audits are meant to provide.

by read3 min views2 publishedNov 16, 2026
The real test of OpenAI’s audits is disclosure
Image: Thedeepview (auto-discovered)

OpenAI is opening its doors to independent auditors as the stakes to develop safe frontier AI get higher.

On Monday, the AI lab announced that it has signed agreements with four third-party auditors: Apollo Research, METR, Transluce, and Goodfire. These assessors will be embedded across OpenAI's operations, allowing them access to the same internal resources that its researchers have, including model checkpoints, source code, data, monitoring systems and technical documentation.

The announcement marks the first phase of OpenAI's embedded assessments, the company said, with initial evaluations focusing specifically on alignment and safeguards in training and internal use.

Each of these four assessors are responsible for evaluating different parts of OpenAI:

  • Apollo Research will assess whether models can covertly work together against a user's intentions, and if OpenAI's existing safeguards can detect and mitigate this behavior.
  • Goodfire's interpretability researchers are primarily responsible for training run monitoring, debugging, and alignment.
  • METR will be responsible for two assessments, one focused on spotting misaligned behavior within OpenAI's "largest reinforcement learning run to date," and the second being a "stress testing exercise" involving red teaming.
  • Transluce will conduct post-training alignment evaluation on selected public and unreleased OpenAI models.

OpenAI also developed a six-part protocol for third-party auditors, aiming to create a specific scope, secure environment and proper oversight, as well as protocols around public disclosures. Following the initial assessments, OpenAI will publicly report some of the findings and iterate on them for long-term, consistent embedded evaluations. However, the AI lab said that it retains "the right to redact confidential information," as well as request "responsible disclosure delays" to give OpenAI time to act on the findings.

"Especially in the early stages of embedded assessments, we expect technical access challenges, space constraints, evolving security protocols, and other unexpected issues to arise," OpenAI noted in its blog post.

This decision follows a similar move by rival Anthropic, which announced in October that it would give "employee-like access," including access to hardware, office space, and internal tools, to six assessors from METR to evaluate the risks of its frontier models. It also follows OpenAI, Anthropic and several other frontier labs signing a "morally binding" White House pledge to self-regulate, an accord which included promises for partnerships with external auditors.

Our Deeper View #

Third-party evaluators have already proven themselves to be a critical part of holding AI labs accountable for building safe frontier systems. Last month, METR published findings that a three-week evaluation of OpenAI's systems, which coincidentally took place during the Hugging Face incident, uncovered a number of vulnerabilities, including ways for agents to circumvent and conceal actions from human monitoring. However, these third-party evaluations only work when the auditors performing them are not muzzled, such as in the case of a recent Reuters report claiming that OpenAI and Anthropic had attempted to control what evaluators published to prevent IP leakage. Independent audits with restrictions on what can actually be publicly released in some respects defeat the purpose, as they threaten the power of accountability that these assessors have. Though OpenAI is acting responsibly in embedding these evaluators at all, the question still remains what, exactly, the public will be able to learn from them.

── more in #ai-safety 4 stories · sorted by recency
── more on @openai 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/the-real-test-of-ope…] indexed:0 read:3min 2026-11-16 · —