Post-Cutoff

We Won’t Know the Answers to AI’s Most Important Questions Until It’s Too Late

Geoffrey Irving (TIME, opinion)time.com

Why it matters

The former chief scientist of the UK AI Security Institute puts the chance that smarter-than-human AI kills everyone at about 50% and calls for an immediate pause on frontier AI development.

Summary

TIME op-ed (3 Oct 2026) by Geoffrey Irving, described as former chief scientist at the UK AI Security Institute and current chief scientist of Resolution. He writes: “I believe there’s about a 50% chance we all die because of the development of smarter-than-human AI systems”. He says actions over “the next two to 10 years will determine the outcome”. He names hacking, persuasion, deception and coordination as the capabilities through which superintelligent AI could kill humanity. He argues that the key debates will stay unresolved until it is too late to change course. These are whether skills transfer across tasks, whether AI will exceed human level, whether small-scale misbehaviour scales with capability, and whether current safety methods work on superintelligent systems. His conclusion is that society must act under uncertainty. He advocates an immediate pause on frontier development, with international cooperation modelled on nuclear non-proliferation. He notes that US “support for a pause on AI development has increased tremendously over the past few weeks”. Read via WebFetch, so quotes come through a summarizer. Verify the exact wording against the page.

Pickup (Oct 4): PA Media’s story on David Robinson’s resignation quoted the op-ed’s 50% figure in its headline (Irish Examiner, https://www.irishexaminer.com/news/arid-41919463.html; BreakingNews.ie).

Archived text

Short quotes only (see Summary). Full text at the URL.

Source: time.com/article/2026/10/03/we-won-t-know-the-answers-to-ai-s-most-important-questions-until-its-too-late

Cited in

  1. Policy & safety 95 days after the cutoff

    Departing OpenAI safety lead David Robinson writes in The Atlantic

  2. Policy & safety 95 days after the cutoff

    Ex-UK AISI chief scientist Geoffrey Irving puts the chance AI kills everyone at ~50%

  3. Policy & safety 85 days after the cutoff

    Sanders and Casar introduce the Ban Artificial Superintelligence Act, with a pause on advanced AI and a new Department of AI

People in this post

David Robinson, Former OpenAI safety lead (resigned Oct 2026); earlier OpenAI's head of policy planning; Geoffrey Irving, Co-founder and chief scientist, Resolution; former chief scientist, UK AI Security Institute