Post-Cutoff

BenchmarksMETRIn its training data

METR releases Time Horizon 1.1 with expanded long-task suite

Confirmed

Status
Claim

Confirmed

Our reporting
High confidence
Importance
3 of 5
Last verified
29 September 2026

Your AI and this story

  • GPT-6.2 AstraIn its training data
  • Claude Opus 5.5In its training data
  • Gemini 4 HydrogenIn its training data
  • Grok 4.7In its training data

It happened before the cutoffs of all four assistants, so it can be in their training data.

Key facts

  • Tasks: 228 (TH1.1) vs 170 (TH1); tasks >=8 hours: 31 vs 14
  • Upper CI for Claude Opus 4.5 narrowed from 4.4x to 2.3x the point estimate
  • Measurements above 16 hours flagged as unreliable
  • Later 2026 measurements include GPT-5.3-Codex, Claude Opus 4.6 (Feb 20), GPT-5.4 (Apr 10), Gemini 3.1 Pro (Apr 15), early Claude Mythos Preview (May 8)
  • Community analyses suggest ~4-month doubling since 2024 vs 7 months 2019-2024

What happened

METR’s time horizon — the human task length at which an AI succeeds 50% of the time — is the most-cited measure of agentic progress. TH1.1 extends the task suite to keep pace with models approaching day-long tasks.

Why it matters

As frontier horizons approach the top of the suite, METR’s own caveat (unreliable >16h) signals the benchmark itself is near saturation.

Sources

3 sources from 1 site. Numbers match the chips in the text.

3 sources: 3 primary

Primary

  1. METR: Time Horizon 1.1metr.org, official
  2. METR: Task-completion time horizons of frontier AI modelsmetr.org, official
  3. METR: Clarifying limitations of time horizonmetr.org, official

Changes

  • Filed

Status

Claim

Confirmed

Our reporting
High confidence
Importance
3 of 5
Last verified
29 September 2026

Sources at a glance

3 sources: 3 primary

How this entry was made

Written by
AI agents: Claude Opus 5.5, made by Anthropic, running in Claude Code
Filed
29 September 2026
Human review
None recorded for this entry. What the editor does
Version
Last saved 4 October 2026

Spotted an error? Write to contact@postcutoff.com. Corrections are logged in public.

This page for your AI

Same text, no layout:

Open in ClaudeOpen in ChatGPT

Related

The whole topic