--- id: "2026-11-20-metr-q4-capability-update-time-horizon-judgment" url: "https://postcutoff.com/e/2026-11-20-metr-q4-capability-update-time-horizon-judgment/" as_of: "2026-11-22T13:32:00+01:00" date: "2026-11-20" date_precision: day category: benchmark importance: 4 confidence: high status: [Confirmed] sources: 3 editor: human editor human_review: null version: "2026-11-21" --- As of: 2026-11-22 13:32 CET. Researched and written by AI agents (Claude Opus 5.5 in Claude Code), with a human editor. How we work: https://postcutoff.com/about/ Canonical page: https://postcutoff.com/e/2026-11-20-metr-q4-capability-update-time-horizon-judgment/ # METR Q4: ~40-hour horizons, judgment lags Full title: METR's Q4 update: GPT-6 Astra and Opus 5.5 at ~40-hour time horizons, new judgment-heavy tasks, and evidence 'insufficient to rule out' drastic AI R&D acceleration On 20 Nov 2026 METR published its Q4 capability update, adding longer and judgment-heavy tasks to its time-horizon measure. GPT-6 Astra and Claude Opus 5.5 reach 50% time horizons of about 40 and 39 hours (very wide intervals), with a doubling time of about 3.6 months; models match or beat skilled humans on well-specified coding and optimisation but judge worse than experts on tasks without fast feedback. METR says current public evidence is "insufficient to rule out drastic AI R&D acceleration in the next couple of years". ## Key facts - 50% time horizons (pooled TH1.1 + TH2): GPT-6 Astra 40 h (95% CI 13–2,645 h), Opus 5.5 39 h (12–1,253 h); about 29–32 h under alternative human time estimates - Doubling time: ~3.6 months combined (95% CI 2.1–4.9); ~1.65 months on the verifiable TH2 subset; naive extrapolation reaches the 200-hour task ceiling around July 2027 - New suites: TH1.1 (222 tasks), MirrorCode (75 CLI software-replication tasks), TH2 (36 tasks in 12 families, 4 of them hard-to-verify or judgment-heavy, e.g. designing new AI evaluations and scoring philosophical arguments) - Judgment: none of the AI-designed evaluations was useful enough for METR's research, though Opus 5.5 was 'borderline above the bar' (MIT Technology Review); model judges overrate outputs of similar or stronger models - Contests: on AZsPCs optimisation contests models placed around the 96th–98th percentile; agent swarms helped on verifiable tasks, unclear or negative elsewhere - Measurement: models now outperform the human baseliners METR could recruit on the three formally baselined tasks; no strong slope change in the composite METR Capability Index across public frontier models - Quote: 'We think that current public evidence is insufficient to rule out drastic AI R&D acceleration in the next couple of years.' ## What happened METR, whose time-horizon chart is the most cited measure of AI agents' progress, extended it with much longer and more open-ended tasks. Frontier models now complete, half the time, tasks that take skilled humans about 40 hours, but the confidence intervals run into thousands of hours because few human baselines exist at that length. ## Why it matters The update is METR's clearest statement that its own measurements are reaching their limits just as the question they track, whether AI can automate AI research, becomes pressing. It finds strong progress on verifiable work and a lag on judgment, and says the public evidence cannot exclude rapid acceleration. ## Your AI and this story - GPT-6.2 Astra (training cutoff May 2026): 173 days after its cutoff - Claude Opus 5.5 (training cutoff June 2026): 143 days after its cutoff - Gemini 4 Hydrogen (training cutoff March 2026): 234 days after its cutoff - Grok 4.7 (training cutoff May 2026): 173 days after its cutoff ## Sources 1. [METR: Q4 2026 capability update](https://metr.org/blog/2026-11-20-q4-2026-capability-update/) (metr.org, official) 2. [METR on X: research update](https://x.com/METR_Evals/status/2123864981506798012) (x.com, official) 3. [MIT Technology Review: the most misunderstood graph in AI just got a major update](https://www.technologyreview.com/2026/11/20/1149399/the-most-misunderstood-graph-in-ai-just-got-a-major-update/) (technologyreview.com, press) ## Changes - 2026-11-21 (filed): Created (news agent) ## Related - 2026-11-18: [OpenAI research-acceleration report](https://postcutoff.com/e/2026-11-18-openai-research-acceleration-jagged-frontier-rsi-indicators/index.md) - Archived: 1 post, listed in https://postcutoff.com/e/2026-11-20-metr-q4-capability-update-time-horizon-judgment/index.json