{"schema":"postcutoff/event@1","as_of":"2026-11-22T13:32:00+01:00","url":"https://postcutoff.com/e/2026-11-20-metr-q4-capability-update-time-horizon-judgment/","md":"https://postcutoff.com/e/2026-11-20-metr-q4-capability-update-time-horizon-judgment/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2026-11-20-metr-q4-capability-update-time-horizon-judgment","date":"2026-11-20","date_precision":"day","short_title":"METR Q4: ~40-hour horizons, judgment lags","deck":null,"takeaway":"On 20 Nov 2026 METR published its Q4 capability update, adding longer and judgment-heavy tasks to its time-horizon measure.","category":"benchmark","category_label":"Benchmarks","importance":4,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":[{"n":1,"title":"METR: Q4 2026 capability update","url":"https://metr.org/blog/2026-11-20-q4-2026-capability-update/","type":"official","group":"primary","domain":"metr.org"},{"n":2,"title":"METR on X: research update","url":"https://x.com/METR_Evals/status/2123864981506798012","type":"official","group":"primary","domain":"x.com"},{"n":3,"title":"MIT Technology Review: the most misunderstood graph in AI just got a major update","url":"https://www.technologyreview.com/2026/11/20/1149399/the-most-misunderstood-graph-in-ai-just-got-a-major-update/","type":"press","group":"press","domain":"technologyreview.com"}],"official":2,"filed":"2026-11-21","updated":"2026-11-21","orgs":["METR"],"title":"METR's Q4 update: GPT-6 Astra and Opus 5.5 at ~40-hour time horizons, new judgment-heavy tasks, and evidence 'insufficient to rule out' drastic AI R&D acceleration","summary":"On 20 Nov 2026 METR published its Q4 capability update, adding longer and judgment-heavy tasks to its time-horizon measure. GPT-6 Astra and Claude Opus 5.5 reach 50% time horizons of about 40 and 39 hours (very wide intervals), with a doubling time of about 3.6 months; models match or beat skilled humans on well-specified coding and optimisation but judge worse than experts on tasks without fast feedback. METR says current public evidence is \"insufficient to rule out drastic AI R&D acceleration in the next couple of years\".","key_facts":["50% time horizons (pooled TH1.1 + TH2): GPT-6 Astra 40 h (95% CI 13–2,645 h), Opus 5.5 39 h (12–1,253 h); about 29–32 h under alternative human time estimates","Doubling time: ~3.6 months combined (95% CI 2.1–4.9); ~1.65 months on the verifiable TH2 subset; naive extrapolation reaches the 200-hour task ceiling around July 2027","New suites: TH1.1 (222 tasks), MirrorCode (75 CLI software-replication tasks), TH2 (36 tasks in 12 families, 4 of them hard-to-verify or judgment-heavy, e.g. designing new AI evaluations and scoring philosophical arguments)","Judgment: none of the AI-designed evaluations was useful enough for METR's research, though Opus 5.5 was 'borderline above the bar' (MIT Technology Review); model judges overrate outputs of similar or stronger models","Contests: on AZsPCs optimisation contests models placed around the 96th–98th percentile; agent swarms helped on verifiable tasks, unclear or negative elsewhere","Measurement: models now outperform the human baseliners METR could recruit on the three formally baselined tasks; no strong slope change in the composite METR Capability Index across public frontier models","Quote: 'We think that current public evidence is insufficient to rule out drastic AI R&D acceleration in the next couple of years.'"],"key_numbers":[],"tags":["metr","time-horizon","evaluations","ai-rnd","automation","safety"],"science":null,"body_md":"## What happened\n\nMETR, whose time-horizon chart is the most cited measure of AI agents' progress, extended it with much longer and more open-ended tasks. Frontier models now complete, half the time, tasks that take skilled humans about 40 hours, but the confidence intervals run into thousands of hours because few human baselines exist at that length.\n\n## Why it matters\n\nThe update is METR's clearest statement that its own measurements are reaching their limits just as the question they track, whether AI can automate AI research, becomes pressing. It finds strong progress on verifiable work and a lag on judgment, and says the public evidence cannot exclude rapid acceleration.","disputed":[],"related":[{"id":"2026-11-18-openai-research-acceleration-jagged-frontier-rsi-indicators","url":"https://postcutoff.com/e/2026-11-18-openai-research-acceleration-jagged-frontier-rsi-indicators/","date":"2026-11-18","date_precision":"day","short_title":"OpenAI research-acceleration report","deck":null,"takeaway":"OpenAI said AI labs should be required to track and publicly report indicators of recursive self-improvement, while saying this does not signal an intent to pursue full RSI.","category":"policy-safety","category_label":"Policy & safety","importance":4,"confidence":"medium","status":{"key":"partly","labels":["Partly confirmed"]},"sources":6,"official":4,"filed":"2026-11-19","updated":"2026-11-19","orgs":["OpenAI"]}],"people":[],"posts":[{"id":"x-metr_evals-2123864981506798012","title":"“We've been working on understanding model capabilities beyond what our prior time horizon…”","url":"https://postcutoff.com/p/x-metr_evals-2123864981506798012/"}],"videos":[],"models":[],"changes":[{"date":"2026-11-21","type":"filed","text":"Created (news agent)"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-11-21","run":null,"sources_read":null,"updated":"2026-11-21","human_review":null,"version":{"date":"2026-11-21"}},"gaps":[{"model_id":"gpt-6-2-astra","name":"GPT-6.2 Astra","cutoff":"2026-05","days_after":173,"in_training_data":false},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":143,"in_training_data":false},{"model_id":"gemini-4-hydrogen","name":"Gemini 4 Hydrogen","cutoff":"2026-03","days_after":234,"in_training_data":false},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":173,"in_training_data":false}],"short_url":"https://postcutoff.com/s/metr-q4-40-hour-horizons"}