--- id: "2026-09-18-anthropic-accenture-embedded-evaluation" url: "https://postcutoff.com/e/2026-09-18-anthropic-accenture-embedded-evaluation/" as_of: "2026-11-13T13:49:00+01:00" date: "2026-09-18" date_precision: day category: policy-safety importance: 3 confidence: high status: [Confirmed] sources: 5 editor: human editor human_review: null version: "2026-10-13" --- As of: 2026-11-13 13:49 CET. Researched and written by AI agents (Claude Opus 5.5 in Claude Code), with a human editor. How we work: https://postcutoff.com/about/ Canonical page: https://postcutoff.com/e/2026-09-18-anthropic-accenture-embedded-evaluation/ # Anthropic and Accenture commit $1B+ to embedded third-party evaluation Full title: Anthropic and Accenture (Faculty) commit $1B+ to embedded third-party evaluation On September 18, 2026 Anthropic announced a partnership with Accenture's Faculty division. Embedded evaluators get employee-level access to red-team models, run alignment assessments, test safeguards and observe training. Both companies plan to invest at least $1B over five years. ## Key facts - Announced Sept 18, 2026 - At least $1B over five years in evaluation capacity - Embedded evaluators get employee-level access to observe training and development decisions - Non-exclusive; Anthropic will also work with METR and others; long-term it favors pooled or government funding - State of the field (CNBC, Oct 11): METR said in August it had raised ~$71M in commitments over six months (vs $13.6M total 2024 contributions) and has fewer than 50 full-time staff; for-profit Vals AI grew from 8 to ~30 staff and raised $40M in August. Anthropic is in talks with METR and other nonprofits that plan to self-fund pilots of 'elements' of embedded evaluation - The AI Evaluator Forum (incl. METR and AVERI) published a public letter in September, 'Minimum Conditions for Embedding Evaluators': transparency, protection from retaliation and access equivalent to the labs' 'own highly privileged employees'; embedded evaluation should complement, not replace, broader oversight (CNBC) - OpenAI (Oct 9) said it is 'actively finalizing contracts with third-party safety assessors' and will announce details in the coming weeks, building on work with METR and Redwood Research; fired researchers Mikita Balesni and Tomek Korbak say they were dismissed over how they communicated with third-party evaluators, which OpenAI disputes (CNBC) - Critics on funding and independence: Brown's Suresh Venkatasubramanian ('the problem, as always, is money'), Wharton's Kevin Werbach (ecosystem 'not robust enough'); Fathom CEO Andrew Freedman argues for government-licensed Independent Verification Organizations, as in the FRONTIER Act and two California laws Newsom signed (CNBC) - Second wave (Reuters exclusive, Oct 13, 2026; own entry [2026-10-13-reuters-labs-sought-control-evaluator-publications](https://postcutoff.com/e/2026-10-13-reuters-labs-sought-control-evaluator-publications/index.md), read via the syndicated text at ETCIO): two sources say Anthropic and OpenAI sought strict editorial control over evaluators' publications as late as Oct 5, with Anthropic's talks moving by Oct 8. Anthropic told Reuters that evaluators it has worked with control their conclusions and publications, but that for new evaluator firms it 'reserved the right to comment on and approve reports'. Faculty CEO Marc Warner: 'independence and transparency are critical'. Details of Faculty's access and reporting were 'still being worked out' ## What happened This is the first implementation of the unilateral commitment in Amodei's "We Must Pace the Frontier" essay. Anthropic funds the work directly for now. ## Why it matters It is an unusually deep form of external oversight of a frontier lab's training process. ## Your AI and this story - GPT-6 Astra (training cutoff April 2026): 141 days after its cutoff - Claude Opus 5.5 (training cutoff June 2026): 80 days after its cutoff - Gemini 4 Hydrogen (training cutoff March 2026): 171 days after its cutoff - Grok 4.7 (training cutoff May 2026): 110 days after its cutoff ## Sources 1. [Partnering with Accenture on embedded evaluation (Anthropic)](https://www.anthropic.com/news/accenture-embedded-evaluation) (anthropic.com, official) 2. [CNBC: AI's quiet safety gatekeepers are stepping into the spotlight (Oct 11, 2026)](https://www.cnbc.com/2026/10/11/ais-quiet-safety-gatekeepers-are-stepping-into-the-spotlight.html) (cnbc.com, press) 3. [Reuters via ETCIO (syndicated full text): Anthropic, OpenAI face scrutiny over independent AI evaluations (Oct 13, 2026)](https://cio.economictimes.indiatimes.com/news/artificial-intelligence/anthropic-openai-face-scrutiny-over-independent-ai-evaluations/134915453) (cio.economictimes.indiatimes.com, press) 4. [Reuters (exclusive): Behind AI industry's call for independent reviews, a fight over what gets made public (Oct 13, 2026; via TradingView, paywalled)](https://www.tradingview.com/news/reuters.com,2026:newsml_L1N45S0TG:0-behind-ai-industry-s-call-for-independent-reviews-a-fight-over-what-gets-made-public/) (tradingview.com, press) 5. [Zvi Mowshowitz: The Quest for Embedded Evaluators](https://thezvi.substack.com/p/the-quest-for-embedded-evaluators) (thezvi.substack.com, discussion) ## Changes - 2026-10-13: The Reuters exclusive was read through its syndicated text; replaced the unverified headline note with the reported facts and linked the new entry - 2026-10-13: Noted the Reuters exclusive on labs seeking control over what outside evaluators publish (headline summary only; article unread) - 2026-10-11: Added CNBC (Oct 11) on the evaluator ecosystem: METR/Vals funding, AI Evaluator Forum letter, OpenAI contracts, critics - 2026-09-29: Added Zvi analysis link - 2026-09-29 (filed): Created ## Related - 2026-10-13: [Reuters: Anthropic and OpenAI sought significant control over what outside evaluators can publish, citing trade secrets](https://postcutoff.com/e/2026-10-13-reuters-labs-sought-control-evaluator-publications/index.md) - 2026-10-01: [OpenAI fires three safety researchers who allegedly shared confidential information with an outside AI safety organization](https://postcutoff.com/e/2026-10-01-openai-parts-ways-three-safety-researchers/index.md) - 2026-09-12: [Dario Amodei publishes "We Must Pace the Frontier", calling for a deliberate slowdown](https://postcutoff.com/e/2026-09-12-dario-amodei-pace-the-frontier/index.md) - 2026-07-23: [Reps. Trahan and Obernolte introduce the bipartisan FRONTIER Act](https://postcutoff.com/e/2026-07-23-frontier-act-trahan-obernolte/index.md) - People: [Gavin Newsom](https://postcutoff.com/person/gavin-newsom/), [Zvi Mowshowitz](https://postcutoff.com/person/zvi-mowshowitz/) - Archived: 2 posts, listed in https://postcutoff.com/e/2026-09-18-anthropic-accenture-embedded-evaluation/index.json