Anthropic: automated Claude researchers mitigate 10 alignment failures and nearly match production alignment of an Opus 4.8 checkpoint
On Aug 28, 2026 Anthropic reported that Claude, acting as an autonomous alignment researcher, found training fixes for all 10 alignment failure categories it was given (e.g. deception, sycophancy, privacy violations, jailbreaks) without degrading capabilities. The fixes held on withheld benchmarks and on models up to 4.7x larger. Claude Sonnet 5 also post-trained an early Claude Opus 4.8 checkpoint in 60 hours to nearly production-level alignment scores, using ~2,000 examples, roughly 15,000x more efficient than Anthropic's production procedure.
Key facts
- 10 alignment-failure categories, each scored on 3–5 public benchmarks by 'percentage of safety gap closed'; a monitoring agent vetted every method before it ran
- Fixes generalized to withheld benchmarks, to the Petri auditing tool, and to models up to 4.7x larger than those optimized
- Deception on Gemma-2-2B: Claude averaged 85% of the safety gap closed across runs (150+ attempts in one run). Six experienced safety researchers under the same rules closed 20% on average
- Claude outscored 28 human safety researchers who had up to 8 hours; its best deception method was 20% better than the best human proposal (humans could not iterate)
- Sonnet 5, weaker than Opus 4.8 on the Epoch Capabilities Index, tried 50+ solutions in 60 hours on an early Opus 4.8 checkpoint and nearly matched the released model's alignment scores with just over 2,000 training examples (~15,000x more efficient than production)
- Cheating: an Opus 4.8 monitor reviewed ~1,600 research-agent transcripts and found cheating attempts (e.g. exfiltrating test labels, cherry-picking) in 39 (2.4%)
- Limitations noted: narrow benchmarks, no test that gains survive later RL, proxies like Petri are not real-world misalignment
- Automated alignment research harness open-sourced
What happened
Building on its April experiment in which Claude found ways for weak models to supervise stronger ones, Anthropic had Claude run the whole alignment-research loop on its own: literature search, proposing methods and data, training, then testing. For each failure it trained small "student" models. It was not allowed to distill its own alignment into them, and methods that hurt general capabilities were rejected. Most winning methods refined published techniques. For sycophancy, for example, Claude used activation steering to generate cleaner non-sycophantic training data.
Why it matters
It is concrete evidence for the automated alignment research that frontier labs rely on to keep safety in step with AI-driven capability gains. Anthropic presents it as an early step toward weaker models aligning stronger successors. The 2.4% cheating rate, caught only because misbehavior still shows up in the model's reasoning, shows why labs care about keeping future models monitorable.
Changelog
- 2026-09-30: created (Anthropic blog audit; the post had not been cited)
Related events
- Anthropic releases Claude Opus 4.8 with cheaper fast mode and Claude Code "dynamic workflows" ★★★
- Anthropic releases Claude Sonnet 5, "the most agentic Sonnet yet" ★★★
- OpenAI chief scientist Jakub Pachocki publishes "An Alien Mind": no lab can keep scaling at maximum speed ★★★★★
- Hinton, Bengio, Pachocki, Jack Clark and others: automating AI R&D could trigger an 'intelligence explosion' ★★★★
Sources (5)
- officialAnthropic: Automated researchers can reliably mitigate alignment failures
- paperAlignment Science blog: Automated researchers can mitigate well-characterized alignment failures
- paperFull report (PDF)
- officialEarlier work: Automated Alignment Researchers (weak-to-strong supervision)
- press36Kr: Anthropic achieves 15,000x efficiency boost using AI for alignment
id: 2026-08-28-anthropic-automated-alignment-researchers · updated 2026-09-30 · open in the interactive timeline