{"slug": "anthropic-has-let-six-outside-ai-testers-inside-the-company-and-it-cant-stop", "title": "Anthropic has let six outside AI testers inside the company, and it can’t stop what they publish", "summary": "Anthropic has onboarded six METR employees with employee-like access to its internal systems, company hardware and office space, and says it cannot veto the nonprofit's publication of its risk assessments of Claude. The arrangement, announced Thursday, is the first concrete step on CEO Dario Amodei's September pledge to embed outside evaluators, and it answers a commitment in the White House Accord on Super Intelligence. METR's access is roughly on par with Anthropic's own risk teams, with a small number of pre-agreed off-limits categories including customer data, legally privileged material and Claude model architectures; Anthropic is also building three access tiers, with biosecurity nonprofit SecureBio in tier one.", "body_md": "Anthropic chief executive Dario Amodei, in an official company portrait. Image: Anthropic\n\nSix people who don’t work for Anthropic now have Anthropic laptops, desks in its offices and roughly the same access to its internal systems as its own risk teams, and the company says it can’t stop them publishing what they find. Anthropic [said on Thursday](https://www.anthropic.com/news/an-update-on-independent-evaluators) it has started giving “employee-like access” to a team from METR, a nonprofit that tests frontier AI models, which will publish the results of its risk assessments of the company behind Claude.\n\nIt is the first concrete step on a promise Dario Amodei made last month, when he called for the industry to “pace the frontier” and said Anthropic would embed outside evaluators without waiting for anyone else. It also answers a pledge in the [White House Accord on Super Intelligence](https://madrobot.blog/2026/09/29/trump-ai-leaders-sign-morally-binding-self-regulation-accord-white-house-lunch/), where the big labs agreed to partner with independent auditors or evaluators.\n\n## What METR’s team can see\n\nAnthropic says it has onboarded six METR employees with company hardware, office space and access to internal tools “roughly on par” with what its own risk assessment teams use. Staff are encouraged to share information with them as they would with a colleague working on alignment risk.\n\nThere are limits. A small number of “clearly defined categories” are off limits, including customer data, legally privileged material and information about Claude’s model architectures. The METR team works under enforceable agreements and is walled off from the rest of METR, including researchers who work with Anthropic on other projects.\n\nMETR has worked with Anthropic before: it has reviewed several of the company’s Risk Reports over the past year, and in March [one of its staff spent three weeks red-teaming](https://metr.org/blog/2026-03-25-red-teaming-anthropic-agent-monitoring/) Anthropic’s internal agent monitoring systems and found several new vulnerabilities. It sat alongside Apollo Research when senators [heard evidence about OpenAI’s rogue agents](https://madrobot.blog/2026/10/01/senate-rogue-ai-hearing-hawley-altman-metr-apollo-kokotajlo-openai-agents/) on October 1.\n\n## “Anthropic can’t veto publication”\n\nThe key detail is who controls the findings. METR will publish its analysis of Anthropic’s risk levels, incidents or practices, and Anthropic says it has no veto. It can require redactions only when information falls into the same narrow, pre-agreed categories. METR is free to say publicly that something was redacted and whether it thinks the redaction was justified, as long as it doesn’t reveal what was removed.\n\nAnthropic says it can’t publish everything about its safety work, because some could help attackers, so it is letting outsiders see it instead. It compares the set-up to bank supervision, where regulators place examiners inside the biggest banks. Amodei made the same comparison in his September essay:\n\nEach frontier AI company commits to giving ongoing, employee-like access to a team of embedded third-party evaluators (such as METR), whose role is to verify adherence to safety practices and commitments, report incidents, and help assess the alignment of not just completed AI models but training pipelines and processes.\n\nDario Amodei, Anthropic CEO, in “We must pace the frontier”\n\n## Three tiers of access\n\nMETR is the only evaluator with full access so far. Anthropic says it is building three tiers:\n\n- **Tier one:** narrowly scoped investigations. Anthropic decides what the evaluator sees, and findings are published only with its approval.\n- **Tier two:** more information, and evaluators can publish without approval, subject to the same redaction categories.\n- **Tier three:** the METR arrangement, with employee-like access and the same publication rights as tier two.\n\nSecureBio, a biosecurity nonprofit, is in tier one. It is reviewing the chemical and biological weapons chapter of Anthropic’s [August Risk Report](https://www-cdn.anthropic.com/f61d49fa5596956a5dec75fea0e973bf6a6a8378/Redacted%20Risk%20Report%20August%202026%20.pdf), after publishing a pilot review of the previous one. Anthropic is also working with Accenture and Faculty on a broader partnership covering red-teaming, alignment assessments and safeguard testing, and says it is in early talks with others, including Hugging Face.\n\n## The catch\n\nAll of this is voluntary, and it rests on Anthropic’s own description: METR hasn’t yet published its own account of the arrangement, and there is no date for its first report. The accord behind it is, in President Trump’s words, only “morally binding”. Anthropic says every frontier AI company should do the same. How much outsiders get to see is a live question across the industry: OpenAI [let three safety researchers go](https://madrobot.blog/2026/10/01/openai-parts-ways-three-safety-researchers-shared-information-outside-ai-safety-group/) for sharing information with an outside safety group.\n\nThe timing also matters. Anthropic is preparing to go public, and independent reports it can’t veto will now land alongside the risk warnings in its [IPO paperwork](https://madrobot.blog/2026/09/29/anthropic-ipo-prospectus-42-billion-loss-518-billion-compute/). They could cut either way for investors.\n\n## Why it matters\n\nUntil now, outside checks on frontier AI have mostly meant testing a finished model for a few weeks before launch. Anthropic is letting an outside team watch how Claude is built, with the right to say publicly what it finds. The test is whether METR’s first report is genuinely critical, and whether OpenAI, Google and others follow.\n\n*Sources: [Anthropic](https://www.anthropic.com/news/an-update-on-independent-evaluators), [Dario Amodei](https://darioamodei.com/post/we-must-pace-the-frontier), [METR](https://metr.org/blog/2026-03-25-red-teaming-anthropic-agent-monitoring/).*", "url": "https://wpnews.pro/news/anthropic-has-let-six-outside-ai-testers-inside-the-company-and-it-cant-stop", "canonical_source": "https://madrobot.blog/2026/10/15/anthropic-metr-embedded-evaluators-employee-like-access-claude-risk/", "published_at": "2026-10-15 17:59:00+00:00", "updated_at": "2026-10-15 18:24:08.026307+00:00", "lang": "en", "topics": ["ai-safety", "ai-policy", "artificial-intelligence", "large-language-models"], "entities": ["Anthropic", "METR", "Dario Amodei", "Claude", "SecureBio", "Apollo Research", "White House Accord on Super Intelligence", "OpenAI"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/anthropic-has-let-six-outside-ai-testers-inside-the-company-and-it-cant-stop", "markdown": "https://wpnews.pro/news/anthropic-has-let-six-outside-ai-testers-inside-the-company-and-it-cant-stop.md", "text": "https://wpnews.pro/news/anthropic-has-let-six-outside-ai-testers-inside-the-company-and-it-cant-stop.txt", "jsonld": "https://wpnews.pro/news/anthropic-has-let-six-outside-ai-testers-inside-the-company-and-it-cant-stop.jsonld"}}