Anthropic and Accenture commit $1B+ to embedded third-party evaluation
Confirmed
The takeaway
On September 18, 2026 Anthropic announced a partnership with Accenture’s Faculty division.
Status
- Claim
Confirmed
- Our reporting
- High confidence
- Importance
- 3 of 5
- Last verified
- 13 October 2026
Your AI and this story
- GPT-6 Astra141 days after its cutoff
- Claude Opus 5.580 days after its cutoff
- Gemini 4 Hydrogen171 days after its cutoff
- Grok 4.7110 days after its cutoff
None of these four assistants can know about it. The closest, Claude Opus 5.5, stops 80 days before it.
Key facts
- Announced Sept 18, 2026
- At least $1B over five years in evaluation capacity
- Embedded evaluators get employee-level access to observe training and development decisions
- Non-exclusive; Anthropic will also work with METR and others; long-term it favors pooled or government funding
- State of the field (CNBC, Oct 11): METR said in August it had raised ~$71M in commitments over six months (vs $13.6M total 2024 contributions) and has fewer than 50 full-time staff; for-profit Vals AI grew from 8 to ~30 staff and raised $40M in August. Anthropic is in talks with METR and other nonprofits that plan to self-fund pilots of ‘elements’ of embedded evaluation
- The AI Evaluator Forum (incl. METR and AVERI) published a public letter in September, ‘Minimum Conditions for Embedding Evaluators’: transparency, protection from retaliation and access equivalent to the labs’ ‘own highly privileged employees’; embedded evaluation should complement, not replace, broader oversight (CNBC)
- OpenAI (Oct 9) said it is ‘actively finalizing contracts with third-party safety assessors’ and will announce details in the coming weeks, building on work with METR and Redwood Research; fired researchers Mikita Balesni and Tomek Korbak say they were dismissed over how they communicated with third-party evaluators, which OpenAI disputes (CNBC)
- Critics on funding and independence: Brown’s Suresh Venkatasubramanian (‘the problem, as always, is money’), Wharton’s Kevin Werbach (ecosystem ‘not robust enough’); Fathom CEO Andrew Freedman argues for government-licensed Independent Verification Organizations, as in the FRONTIER Act and two California laws Newsom signed (CNBC)
Show 1 more
- Second wave (Reuters exclusive, Oct 13, 2026; own entry Reuters: Anthropic and OpenAI sought significant control over what outside evaluators can publish, citing trade secrets, read via the syndicated text at ETCIO): two sources say Anthropic and OpenAI sought strict editorial control over evaluators’ publications as late as Oct 5, with Anthropic’s talks moving by Oct 8. Anthropic told Reuters that evaluators it has worked with control their conclusions and publications, but that for new evaluator firms it ‘reserved the right to comment on and approve reports’. Faculty CEO Marc Warner: ‘independence and transparency are critical’. Details of Faculty’s access and reporting were ‘still being worked out’
What happened
This is the first implementation of the unilateral commitment in Amodei’s “We Must Pace the Frontier” essay. Anthropic funds the work directly for now.
Why it matters
It is an unusually deep form of external oversight of a frontier lab’s training process.
Sources
5 sources from 5 sites. Numbers match the chips in the text.
5 sources: 1 primary, 3 press, 1 reaction
Primary
- Partnering with Accenture on embedded evaluation (Anthropic)anthropic.com, official
Press
- CNBC: AI’s quiet safety gatekeepers are stepping into the spotlight (Oct 11, 2026)cnbc.com, press
- Reuters via ETCIO (syndicated full text): Anthropic, OpenAI face scrutiny over independent AI evaluations (Oct 13, 2026)cio.economictimes.indiatimes.com, press
- Reuters (exclusive): Behind AI industry’s call for independent reviews, a fight over what gets made public (Oct 13, 2026; via TradingView, paywalled)tradingview.com, press
Reactions
- Zvi Mowshowitz: The Quest for Embedded Evaluatorsthezvi.substack.com, discussion
Changes
- The Reuters exclusive was read through its syndicated text; replaced the unverified headline note with the reported facts and linked the new entry
- Noted the Reuters exclusive on labs seeking control over what outside evaluators publish (headline summary only; article unread)
- Added CNBC (Oct 11) on the evaluator ecosystem: METR/Vals funding, AI Evaluator Forum letter, OpenAI contracts, critics
- Added Zvi analysis link
- Filed