METR review of Anthropic’s risk report
AI R&D at Anthropic has sped up about 2x, and the 2x acceleration threshold was ‘plausibly’ crossed by July 15
Confirmed
Importance: historic (5 of 5)Status
- Claim
Confirmed
- Our reporting
- High confidence
- Importance
- Historic (5 of 5)
- Last verified
- 9 November 2026
Your AI and this story
- GPT-6 Astra189 days after its cutoff
- Claude Opus 5.5128 days after its cutoff
- Gemini 4 Argon219 days after its cutoff
- Grok 4.7158 days after its cutoff
None of these four assistants can know about it. The closest, Claude Opus 5.5, stops 128 days before it.
Key facts
- The Verge (Nov 7) reported researchers’ alarm at the METR review’s findings on Anthropic automating parts of AI development
- Nov 7: commentator @kimmonismus (~210k views) said the independent AI 2027 tracker (ai2027-tracker.com, not affiliated with AI Futures Project) puts some Anthropic internal models ahead of the AI 2027 curve on METR’s AECI figures; on Nov 8 the tracker’s public page showed no AECI comparison, so this is unverified
- Ajeya Cotra (Planned Obsolescence, Nov 6; HN 324 points): argues the ‘dramatic acceleration’ threshold has already been crossed; METR attributes ~80% of the ~2x speed-up to AI (~1.8x vs a no-AI counterfactual); she estimates ~10x labour uplift (staff self-report ~12x, undocumented) and says smooth compounding would imply superintelligence within about a year
- Second wave Nov 5-7: Reuters (‘improving nearly twice as fast with help from AI’), AP, Business Insider and ABC News covered the report; a LessWrong shortform doubting that AI R&D is ‘ingenious’ reached 203 HN points; Jeffrey Ladish noted the best evidence was redacted (BigGo)
- METR worked with internal Anthropic information since August 2026; full report ~100 pages, submitted to Anthropic
- Leading-indicator acceleration: 1.3x–2.8x depending on definition and period; METR’s preferred public wording ‘around 2’
- Anthropic’s private report implies ~1.97x; METR calls the public wording ‘less than a factor of 2’ misleading
- 2x Acceleration Threshold: Anthropic says not crossed; METR: ‘we think it is plausible that it had been’ by July 15, though most researchers at both organisations lean ‘not crossed’
Show 6 more
- Full Substitution Threshold: not crossed (METR finds Anthropic’s argument broadly compelling, with less confidence than before)
- Both agree catastrophic risk from July 15th models was low; METR cannot rule out substantial further acceleration within ~6 months, which could raise risk to ‘high’
- AECI estimate rose from ~1.5x to ~1.9x with extra benchmark data, per METR
- Redaction: ‘Anthropic redacted a majority of the evidence we found most informative… the public must rely on our judgment more than we consider ideal’ (METR on X, 287k views); launch thread 1.0M views
- Anthropic co-founder Sam McCandlish (who leads much of its safety work) welcomed the report as ‘an independent, external view’ (X, 458k views)
- The Information’s summary: Anthropic’s models improving about twice as fast as between March 2024 and October 2025, with internal AI use driving most of the acceleration
What happened
METR, given employee-level access to nonpublic Anthropic information from August 2026, reviewed the automated-R&D section of Anthropic’s August 2026 Risk Report. It agrees catastrophic risk from the July 15 models was low, but disagrees with how the public report describes the speed-up: by its leading indicators AI progress at Anthropic is roughly twice as fast as before, and it is “plausible” that Anthropic’s own 2x acceleration threshold had already been crossed. METR asks Anthropic to revise the public wording and to state the 1.3x–2.8x range.
Why it matters
It is the first external, data-backed estimate that a frontier lab’s own AI is measurably speeding up its AI research, the mechanism behind “recursive self-improvement” worries, and also a test of how much an embedded evaluator can tell the public when the lab controls redactions.
Sources
9 sources from 6 sites. Numbers match the chips in the text.
9 sources: 1 primary, 2 press, 6 reactions
Primary
- METR: review of the R&D section of Anthropic’s August 2026 Risk Reportmetr.org, official
Press
- The Verge: Why a new report on Anthropic automating AI development is alarming researcherstheverge.com, press
- The Information: Anthropic’s R&D speed may have doubled due to AI, researchers findtheinformation.com, press
Reactions
- kimmonismus on X: AI 2027 tracker updatex.com, discussion
- METR on X: launch threadx.com, discussion
- METR on X: on Anthropic’s redactionsx.com, discussion
- Sam McCandlish on X: response to METR’s reportx.com, discussion
- Ajeya Cotra: AI is dramatically accelerating AI researchplanned-obsolescence.org, discussion
- LessWrong: I struggle to believe that AI R&D is ingenious (shortform)lesswrong.com, discussion
Changes
- Verge coverage (news agent)
- Added AI 2027 tracker claim (unverified)
- Cotra essay, wire coverage and sceptic thread (news agent)
- Filed