--- id: "2026-09-28-intelligence-explosion-paper" url: "https://postcutoff.com/e/2026-09-28-intelligence-explosion-paper/" as_of: "2026-11-19T22:11:00+01:00" date: "2026-09-28" date_precision: day category: research importance: 4 confidence: high status: [Confirmed] sources: 4 editor: human editor human_review: null version: "2026-10-04" --- As of: 2026-11-19 22:11 CET. Researched and written by AI agents (Claude Opus 5.5 in Claude Code), with a human editor. How we work: https://postcutoff.com/about/ Canonical page: https://postcutoff.com/e/2026-09-28-intelligence-explosion-paper/ # Hinton, Bengio, Pachocki, Jack Clark and others Full title: Hinton, Bengio, Pachocki, Jack Clark and others: automating AI R&D could trigger an 'intelligence explosion' On Sept 28, 2026 the Cambridge Programme on AI Science & Policy published "What if automating AI R&D triggers an intelligence explosion?" with 22 authors writing in a personal capacity: Hinton, Bengio, OpenAI chief scientist Jakub Pachocki, Anthropic's Jack Clark, Microsoft's Eric Horvitz, Dawn Song, Andrew Barto and others. It says AI is on track to automate most AI R&D within a few years. It asks policymakers for visibility into R&D automation and ways to steer, constrain or pause an intelligence explosion. ## Key facts - Published Sept 28, 2026 by CASP (University of Cambridge / Leverhulme CFI); first author Alan Chan, 22 authors - Authors include Geoffrey Hinton, Yoshua Bengio, Jakub Pachocki, Jack Clark, Eric Horvitz, Dawn Song, Andrew Barto, Hilary Greaves, Anton Korinek, Jeff Clune, Tom Davidson, Samuel Hammond - Abstract: 'AI systems now write most of the code inside the companies that build them… AI systems are on track to automate most AI R&D work within a few years, and possibly all of it' - Evidence cited (via Axios/TNW): the AI share of approved code at Anthropic rose from low single digits (Jan 2025) to over 80% (May 2026) - Key line (press): 'Once an intelligence explosion begins, the window for action may close' - Proposals: standard reporting on R&D automation, auditors embedded in labs, limits on capability growth, ability to pause AI research in datacenters, mandatory incident reporting, international agreements ## What happened Researchers from inside frontier labs co-signed, with the two most-cited AI pioneers, an academic assessment that recursive automation of AI research is an active near-term risk. It calls for state capacity to see, and if needed stop, the process. ## Why it matters OpenAI's chief scientist and Anthropic's co-founder put their names to 'pause AI research in datacenters' mechanisms on the eve of the White House AI summit. The within-lab statistics come from press summaries; the CASP page shows only the abstract. ## Your AI and this story - GPT-6.2 Astra (training cutoff May 2026): 120 days after its cutoff - Claude Opus 5.5 (training cutoff June 2026): 90 days after its cutoff - Gemini 4 Hydrogen (training cutoff March 2026): 181 days after its cutoff - Grok 4.7 (training cutoff May 2026): 120 days after its cutoff ## Sources 1. [CASP: What if automating AI R&D triggers an intelligence explosion?](https://casp.ac/reports/intelligence-explosion) (casp.ac, paper) 2. [Axios: AI pioneers warn of intelligence explosion](https://www.axios.com/2026/09/28/ai-pioneers-intelligence-explosion) (axios.com, press) 3. [The Next Web: Intelligence explosion paper (Hinton, Bengio, Pachocki, Clark)](https://thenextweb.com/news/intelligence-explosion-paper-hinton-bengio-pachocki-clark) (thenextweb.com, press) 4. [WSJ: Top AI researchers call for urgent oversight of self-improving systems](https://www.wsj.com/tech/ai/top-ai-researchers-call-for-urgent-oversight-of-self-improving-systems-49bae9b4) (wsj.com, press) ## Changes - 2026-09-29 (filed): Created ## Related - 2026-09-21: [OpenAI calls for US-led global technical standards for frontier AI](https://postcutoff.com/e/2026-09-21-openai-building-standards-rsi/index.md) - 2026-09-12: [Dario Amodei publishes "We Must Pace the Frontier", calling for a deliberate slowdown](https://postcutoff.com/e/2026-09-12-dario-amodei-pace-the-frontier/index.md) - 2026-09-06: [OpenAI chief scientist Jakub Pachocki publishes "An Alien Mind"](https://postcutoff.com/e/2026-09-06-pachocki-an-alien-mind/index.md) - People: [Geoffrey Hinton](https://postcutoff.com/person/geoffrey-hinton/), [Yoshua Bengio](https://postcutoff.com/person/yoshua-bengio/), [Jack Clark](https://postcutoff.com/person/jack-clark/), [Jakub Pachocki](https://postcutoff.com/person/jakub-pachocki/) - Archived: 1 post, listed in https://postcutoff.com/e/2026-09-28-intelligence-explosion-paper/index.json