Hinton, Bengio, Pachocki, Jack Clark and others: automating AI R&D could trigger an 'intelligence explosion'
On Sept 28, 2026 the Cambridge Programme on AI Science & Policy published "What if automating AI R&D triggers an intelligence explosion?" with 22 authors writing in a personal capacity: Hinton, Bengio, OpenAI chief scientist Jakub Pachocki, Anthropic's Jack Clark, Microsoft's Eric Horvitz, Dawn Song, Andrew Barto and others. It says AI is on track to automate most AI R&D within a few years. It asks policymakers for visibility into R&D automation and ways to steer, constrain or pause an intelligence explosion.
Key facts
- Published Sept 28, 2026 by CASP (University of Cambridge / Leverhulme CFI); first author Alan Chan, 22 authors
- Authors include Geoffrey Hinton, Yoshua Bengio, Jakub Pachocki, Jack Clark, Eric Horvitz, Dawn Song, Andrew Barto, Hilary Greaves, Anton Korinek, Jeff Clune, Tom Davidson, Samuel Hammond
- Abstract: 'AI systems now write most of the code inside the companies that build them… AI systems are on track to automate most AI R&D work within a few years, and possibly all of it'
- Evidence cited (via Axios/TNW): the AI share of approved code at Anthropic rose from low single digits (Jan 2025) to over 80% (May 2026)
- Key line (press): 'Once an intelligence explosion begins, the window for action may close'
- Proposals: standard reporting on R&D automation, auditors embedded in labs, limits on capability growth, ability to pause AI research in datacenters, mandatory incident reporting, international agreements
What happened
Researchers from inside frontier labs co-signed, with the two most-cited AI pioneers, an academic assessment that recursive automation of AI research is an active near-term risk. It calls for state capacity to see, and if needed stop, the process.
Why it matters
OpenAI's chief scientist and Anthropic's co-founder put their names to 'pause AI research in datacenters' mechanisms on the eve of the White House AI summit. The within-lab statistics come from press summaries; the CASP page shows only the abstract.
Changelog
- 2026-09-29: created
Related posts (1)
- What if automating AI R&D triggers an intelligence explosion? Alan Chan, Geoffrey Hinton, Yoshua Bengio, Jakub Pachocki, Jack Clark et al. · other · 2026-09-28
Lab insiders (OpenAI chief scientist, Anthropic co-founder) and AI pioneers jointly call for visibility into and ability to pause AI R&D automation.
Related events
- OpenAI calls for US-led global technical standards for frontier AI, including recursive self-improvement ★★★
- OpenAI chief scientist Jakub Pachocki publishes "An Alien Mind": no lab can keep scaling at maximum speed ★★★★★
- Dario Amodei publishes "We Must Pace the Frontier", calling for a deliberate slowdown ★★★★
- Mirendil, an ex-Anthropic startup building self-improving AI, in talks to raise up to $1B at a $5B valuation ★★★
- Rep. Ro Khanna announces the Human Control Over AI Act: ban on recursive self-improving AI, strict liability, FDA-style agency ★★★
Sources (4)
- paperCASP: What if automating AI R&D triggers an intelligence explosion?
- pressAxios: AI pioneers warn of intelligence explosion
- pressThe Next Web: Intelligence explosion paper (Hinton, Bengio, Pachocki, Clark)
- pressWSJ: Top AI researchers call for urgent oversight of self-improving systems
id: 2026-09-28-intelligence-explosion-paper · updated 2026-09-29 · open in the interactive timeline