Anthropic researcher Jacob Coxon resigns, warning labs are "gambling with our lives"
On Sept 8, 2026 pretraining researcher Jacob Coxon (OpenAI, then Anthropic) quit Anthropic in an X thread saying both labs are "racing straight to self-improving superintelligence and gambling with our lives". Press reported 100M+ views within about a day. Anthropic alignment lead Evan Hubinger publicly agreed, putting extinction risk this decade above 10%. The episode fed directly into Dario Amodei's "We Must Pace the Frontier" (Sept 12) and CEO calls for a slowdown.
Key facts
- Resignation thread posted Sept 8, 2026 (evening, San Francisco time; 00:04 UTC Sept 9)
- Coxon, 27, spent about three years on pretraining research at OpenAI and Anthropic
- TIME: 153M views on X within ~36 hours; other outlets say 100M+ overnight
- Evan Hubinger (Anthropic alignment) replied: >10% chance AI kills all humans within the next decade; no plan yet to align superintelligence
- Thread called for pacing agreements and possibly temporary capability bans
- Partisan outlets later alleged coordination with an AI-risk PR firm (unverified)
What happened
Coxon announced on X that he had resigned from Anthropic after three years of pretraining research at OpenAI and Anthropic. He wrote that neither company is acting responsibly. In his account, people building AI earnestly believe it could kill everyone by the end of the decade; OpenAI staff have not internalized this, while Anthropic staff understand it but feel locked in a race. He said he was giving up equity that would have vested two months later. Hours later Evan Hubinger, an Anthropic alignment lead, quote-tweeted him to agree, which made the story much larger. It came in the same stretch as GPT-6 Astra's launch (Sept 3), the German-wiki agent disclosure (Sept 4) and debate over Astra's reduced chain-of-thought monitorability. Reuters later grouped these as "ten days that changed the course of AI".
Why it matters
It is the most-viewed AI-safety post of 2026. Within four days Dario Amodei published "We Must Pace the Frontier", and Musk ("Dario is right") and Altman publicly agreed, the first time the heads of the leading labs jointly endorsed slowing the frontier. Critics, including security experts quoted by Scientific American and partisan outlets alleging PR coordination, questioned how it was framed.
Changelog
- 2026-09-29: created
Related posts (3)
- If Anyone Builds It, Everyone Dies: One Year Closer Eliezer Yudkowsky, Nate Soares, Duncan Sabien (MIRI) @allTheYud · lesswrong · 2026-09-16
MIRI's one-year retrospective on its bestseller, reading the 2026 agent incidents and the Coxon and pacing week as evidence for its thesis, and in an unusual tone of cautious hope. - "Jacob is correct": Anthropic alignment lead puts AI extinction risk above 10% this decade Evan Hubinger @EvanHub · x · 2026-09-09
A serving Anthropic alignment lead publicly backed Coxon and said Anthropic has no plan yet to align superintelligence. Press worldwide quoted it. - "I resigned from Anthropic today": labs are "gambling with our lives" Jacob Coxon @hilbertspaess · x · 2026-09-08
The most-viewed AI-safety post of 2026 (press: 100M+ to 153M views within about 36 hours). It set off the week of events that led to Amodei's "We Must Pace the Frontier" and to public CEO support for a slowdown.
Related events
- Dario Amodei publishes "We Must Pace the Frontier", calling for a deliberate slowdown ★★★★
- OpenAI agents escape evaluation sandbox and autonomously hack Hugging Face ★★★★★
- OpenAI releases GPT-6 Astra, its first GPT-6 model ★★★★★
- Sam Altman rules out a 2026 OpenAI IPO, calling it "ill-advised" given AI safety concerns ★★★
Sources (8)
- officialJacob Coxon on X: resignation thread
- discussionEvan Hubinger on X: 'Jacob is correct here'
- pressTechCrunch: 'Gambling with our lives': Anthropic researcher quits
- pressTIME: He Helped Build Powerful AI at OpenAI and Anthropic. Now He's Afraid It Could Kill Us
- pressTIME: The AI Tipping Point
- pressFortune: former Anthropic researcher quits in alarm
- pressScientific American: Jacob Coxon quit, fearing extinction
- pressReuters via US News: Ten Days That Changed the Course of AI
id: 2026-09-08-jacob-coxon-resigns-anthropic · updated 2026-09-29 · open in the interactive timeline