METR releases Time Horizon 1.1 with expanded long-task suite
Confirmed
Status
- Claim
Confirmed
- Our reporting
- High confidence
- Importance
- 3 of 5
- Last verified
- 29 September 2026
Your AI and this story
- GPT-6.2 AstraIn its training data
- Claude Opus 5.5In its training data
- Gemini 4 HydrogenIn its training data
- Grok 4.7In its training data
It happened before the cutoffs of all four assistants, so it can be in their training data.
Key facts
- Tasks: 228 (TH1.1) vs 170 (TH1); tasks >=8 hours: 31 vs 14
- Upper CI for Claude Opus 4.5 narrowed from 4.4x to 2.3x the point estimate
- Measurements above 16 hours flagged as unreliable
- Later 2026 measurements include GPT-5.3-Codex, Claude Opus 4.6 (Feb 20), GPT-5.4 (Apr 10), Gemini 3.1 Pro (Apr 15), early Claude Mythos Preview (May 8)
- Community analyses suggest ~4-month doubling since 2024 vs 7 months 2019-2024
What happened
METR’s time horizon — the human task length at which an AI succeeds 50% of the time — is the most-cited measure of agentic progress. TH1.1 extends the task suite to keep pace with models approaching day-long tasks.
Why it matters
As frontier horizons approach the top of the suite, METR’s own caveat (unreliable >16h) signals the benchmark itself is near saturation.
Sources
3 sources from 1 site. Numbers match the chips in the text.
3 sources: 3 primary
Primary
- METR: Time Horizon 1.1metr.org, official
- METR: Task-completion time horizons of frontier AI modelsmetr.org, official
- METR: Clarifying limitations of time horizonmetr.org, official
Changes
- Filed