{"schema":"postcutoff/event@1","as_of":"2026-11-19T22:11:00+01:00","url":"https://postcutoff.com/e/2026-09-28-intelligence-explosion-paper/","md":"https://postcutoff.com/e/2026-09-28-intelligence-explosion-paper/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2026-09-28-intelligence-explosion-paper","date":"2026-09-28","date_precision":"day","short_title":"Hinton, Bengio, Pachocki, Jack Clark and others","deck":"Automating AI R&D could trigger an 'intelligence explosion'","takeaway":null,"category":"research","category_label":"Research","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":[{"n":1,"title":"CASP: What if automating AI R&D triggers an intelligence explosion?","url":"https://casp.ac/reports/intelligence-explosion","type":"paper","group":"primary","domain":"casp.ac"},{"n":2,"title":"Axios: AI pioneers warn of intelligence explosion","url":"https://www.axios.com/2026/09/28/ai-pioneers-intelligence-explosion","type":"press","group":"press","domain":"axios.com"},{"n":3,"title":"The Next Web: Intelligence explosion paper (Hinton, Bengio, Pachocki, Clark)","url":"https://thenextweb.com/news/intelligence-explosion-paper-hinton-bengio-pachocki-clark","type":"press","group":"press","domain":"thenextweb.com"},{"n":4,"title":"WSJ: Top AI researchers call for urgent oversight of self-improving systems","url":"https://www.wsj.com/tech/ai/top-ai-researchers-call-for-urgent-oversight-of-self-improving-systems-49bae9b4","type":"press","group":"press","domain":"wsj.com"}],"official":1,"filed":"2026-09-29","updated":"2026-09-29","orgs":["University of Cambridge","OpenAI","Anthropic","Microsoft","Mila"],"title":"Hinton, Bengio, Pachocki, Jack Clark and others: automating AI R&D could trigger an 'intelligence explosion'","summary":"On Sept 28, 2026 the Cambridge Programme on AI Science & Policy published \"What if automating AI R&D triggers an intelligence explosion?\" with 22 authors writing in a personal capacity: Hinton, Bengio, OpenAI chief scientist Jakub Pachocki, Anthropic's Jack Clark, Microsoft's Eric Horvitz, Dawn Song, Andrew Barto and others. It says AI is on track to automate most AI R&D within a few years. It asks policymakers for visibility into R&D automation and ways to steer, constrain or pause an intelligence explosion.","key_facts":["Published Sept 28, 2026 by CASP (University of Cambridge / Leverhulme CFI); first author Alan Chan, 22 authors","Authors include Geoffrey Hinton, Yoshua Bengio, Jakub Pachocki, Jack Clark, Eric Horvitz, Dawn Song, Andrew Barto, Hilary Greaves, Anton Korinek, Jeff Clune, Tom Davidson, Samuel Hammond","Abstract: 'AI systems now write most of the code inside the companies that build them… AI systems are on track to automate most AI R&D work within a few years, and possibly all of it'","Evidence cited (via Axios/TNW): the AI share of approved code at Anthropic rose from low single digits (Jan 2025) to over 80% (May 2026)","Key line (press): 'Once an intelligence explosion begins, the window for action may close'","Proposals: standard reporting on R&D automation, auditors embedded in labs, limits on capability growth, ability to pause AI research in datacenters, mandatory incident reporting, international agreements"],"key_numbers":[],"tags":["ai-safety","recursive-self-improvement","intelligence-explosion","policy","ai-rnd-automation"],"science":null,"body_md":"## What happened\n\nResearchers from inside frontier labs co-signed, with the two most-cited AI pioneers, an academic assessment that recursive automation of AI research is an active near-term risk. It calls for state capacity to see, and if needed stop, the process.\n\n## Why it matters\n\nOpenAI's chief scientist and Anthropic's co-founder put their names to 'pause AI research in datacenters' mechanisms on the eve of the White House AI summit. The within-lab statistics come from press summaries; the CASP page shows only the abstract.","disputed":[],"related":[{"id":"2026-09-21-openai-building-standards-rsi","url":"https://postcutoff.com/e/2026-09-21-openai-building-standards-rsi/","date":"2026-09-21","date_precision":"day","short_title":"OpenAI calls for US-led global technical standards for frontier AI","deck":"Including recursive self-improvement","takeaway":"It is the first time a frontier lab has publicly named RSI as something to standardize and not pursue until safe.","category":"policy-safety","category_label":"Policy & safety","importance":3,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":3,"official":1,"filed":"2026-09-29","updated":"2026-09-29","orgs":["OpenAI"]},{"id":"2026-09-12-dario-amodei-pace-the-frontier","url":"https://postcutoff.com/e/2026-09-12-dario-amodei-pace-the-frontier/","date":"2026-09-12","date_precision":"day","short_title":"Dario Amodei publishes \"We Must Pace the Frontier\", calling for a deliberate slowdown","deck":null,"takeaway":"It is the first time the CEO of a leading frontier lab has publicly called for slowing the frontier and paired the call with a unilateral commitment.","category":"policy-safety","category_label":"Policy & safety","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":10,"official":2,"filed":"2026-09-29","updated":"2026-10-29","orgs":["Anthropic"]},{"id":"2026-09-06-pachocki-an-alien-mind","url":"https://postcutoff.com/e/2026-09-06-pachocki-an-alien-mind/","date":"2026-09-06","date_precision":"day","short_title":"OpenAI chief scientist Jakub Pachocki publishes \"An Alien Mind\"","deck":"No lab has solved alignment well enough to keep scaling at maximum speed for much longer","takeaway":"On Sept 6, 2026, three days after the GPT-6 Astra launch, OpenAI chief scientist Jakub Pachocki published the essay \"An Alien Mind\" on openai.com.","category":"policy-safety","category_label":"Policy & safety","importance":5,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":6,"official":3,"filed":"2026-09-29","updated":"2026-10-04","orgs":["OpenAI"]}],"people":[{"id":"geoffrey-hinton","name":"Geoffrey Hinton","url":"https://postcutoff.com/person/geoffrey-hinton/"},{"id":"yoshua-bengio","name":"Yoshua Bengio","url":"https://postcutoff.com/person/yoshua-bengio/"},{"id":"jack-clark","name":"Jack Clark","url":"https://postcutoff.com/person/jack-clark/"},{"id":"jakub-pachocki","name":"Jakub Pachocki","url":"https://postcutoff.com/person/jakub-pachocki/"}],"posts":[{"id":"2026-09-28-casp-intelligence-explosion","title":"What if automating AI R&D triggers an intelligence explosion?","url":"https://postcutoff.com/p/2026-09-28-casp-intelligence-explosion/"}],"videos":[],"models":[],"changes":[{"date":"2026-09-29","type":"filed","text":"Created"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-09-29","run":null,"sources_read":null,"updated":"2026-09-29","human_review":null,"version":{"date":"2026-10-04"}},"gaps":[{"model_id":"gpt-6-2-astra","name":"GPT-6.2 Astra","cutoff":"2026-05","days_after":120,"in_training_data":false},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":90,"in_training_data":false},{"model_id":"gemini-4-hydrogen","name":"Gemini 4 Hydrogen","cutoff":"2026-03","days_after":181,"in_training_data":false},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":120,"in_training_data":false}],"short_url":"https://postcutoff.com/s/hinton-bengio-pachocki-jack"}