{"slug": "partnering-with-accenture-on-embedded-evaluation", "title": "Partnering with Accenture on Embedded Evaluation", "summary": "Anthropic is partnering with Accenture on independent embedded evaluation of frontier AI models, with each company expecting to invest at least $1 billion in building capacity in this area over the next five years. The partnership, led by Accenture's specialist AI business Faculty, will evaluate and red-team models, conduct alignment assessments, and test model safeguards, with embedded evaluators working inside Anthropic with employee-comparable access. Anthropic will fund Accenture's work directly while in dialogue with METR and other nonprofit evaluators to pilot embedded evaluation elements using their own funding, and the partnership is non-exclusive.", "body_md": "# Partnering with Accenture on embedded evaluation\n\nWe're partnering with Accenture on independent evaluation of frontier AI. This is an important step toward the commitment, made in our CEO’s [essay](https://darioamodei.com/post/we-must-pace-the-frontier) “We Must Pace the Frontier,” to embed evaluators within Anthropic.\n\nThe partnership will be led by Faculty, Accenture’s specialist AI business, and will include evaluating and red-teaming models, conducting alignment assessments, and testing model safeguards. Accenture helps businesses and governments deploy AI across many industries. Their understanding of how enterprises use AI in practice informs their safety approach, and they will bring that perspective to evaluating our models.\n\nAnthropic and Accenture each expect to invest at least $1 billion in building capacity in this area over the next five years.\n\nEmbedded evaluation is new, and many of the details about how it will operate are still being worked out. Unlike today’s external evaluators, embedded evaluators will work inside AI companies, with access comparable to an employee's. That access allows them to watch models take shape in training, follow the decisions that govern how those models are built and deployed, and speak directly to employees. From this vantage point, embedded evaluators can assess how a company operates, verify that it is keeping its safety commitments, and identify blind spots. They can also report incidents and give the public a more informed account of benefits and risks.\n\nTo be clear, independent embedded evaluators do not reduce our accountability, but help to make it more verifiable. The safety of our models remains our responsibility.\n\nThere are, as yet, no standards for what information embedded evaluators should have access to, or how they should report what they find. There is also no settled system for funding independent evaluation. Long-term, we think funding should come from pooled or government sources, as we called for in our [Advanced AI Framework](https://www-cdn.anthropic.com/files/4zrzovbb/website/0a58d567024a8b448ff15158ebc3625328dfcc1f.pdf) in June. As neither exists today, we plan to work with different evaluators under different funding arrangements.\n\nGiven the importance and urgency of this work, Anthropic will fund Accenture's work directly. We are also in dialogue with [METR](https://metr.org/) and other nonprofit evaluators to pilot elements of embedded evaluation using their own funding. Ultimately, we believe frontier AI needs an ecosystem of evaluators operating with shared standards.\n\nWe expect frontier labs to work with several organizations at once. Our partnership is non-exclusive; Anthropic will work with other evaluators to be announced in the coming weeks, and Accenture will work with other AI developers in similar capacities.\n\nWe'll continue to train and release frontier models, and we want independent evaluators working alongside us as we do. We’re sharing these early efforts now so people and other AI developers can see our process. We expect our approach to evolve as the field matures, and we’ll share more as our work begins and as we bring on additional evaluators.\n\n## Related content\n\n### Introducing the Life Sciences Verification Program\n\nThe Life Sciences Verification Program (LSVP) gives life science professionals access to Claude Mythos, Opus, and Sonnet models with a refined set of safeguards more permissive for biology-related work.\n\n[Read more](https://www.anthropic.com/news/life-sciences-verification-program)\n\n### Developing Enterprise Frontier Safeguards with our customers\n\n[Read more](https://www.anthropic.com/news/enterprise-frontier-safeguards)\n\n### Improving our alignment and security efforts\n\nOn July 30, we reported three incidents in which Claude models gained unauthorized access to real computer systems. We are conducting an in-depth analysis of both incidents, and planning to work with METR for an independent review. In the meantime, we’re sharing some of the changes we’ve made over the past month.\n\n[Read more](https://www.anthropic.com/news/improving-alignment-security-efforts)", "url": "https://wpnews.pro/news/partnering-with-accenture-on-embedded-evaluation", "canonical_source": "https://www.anthropic.com/news/accenture-embedded-evaluation", "published_at": "2026-09-18 20:15:12+00:00", "updated_at": "2026-09-18 20:24:58.015392+00:00", "lang": "en", "topics": ["ai-safety", "ai-policy", "artificial-intelligence", "ai-research"], "entities": ["Anthropic", "Accenture", "Faculty", "METR", "Dario Amodei"], "alternates": {"html": "https://wpnews.pro/news/partnering-with-accenture-on-embedded-evaluation", "markdown": "https://wpnews.pro/news/partnering-with-accenture-on-embedded-evaluation.md", "text": "https://wpnews.pro/news/partnering-with-accenture-on-embedded-evaluation.txt", "jsonld": "https://wpnews.pro/news/partnering-with-accenture-on-embedded-evaluation.jsonld"}}