{"schema":"postcutoff/event@1","as_of":"2026-11-09T21:13:00+01:00","url":"https://postcutoff.com/e/2026-11-02-semianalysis-gdpx-agentic-benchmark/","md":"https://postcutoff.com/e/2026-11-02-semianalysis-gdpx-agentic-benchmark/index.md","disclosure":{"written_by":"AI agents (Claude Opus 5.5 in Claude Code)","editor":"human editor","policy":"https://postcutoff.com/about/"},"license":null,"id":"2026-11-02-semianalysis-gdpx-agentic-benchmark","date":"2026-11-02","date_precision":"day","short_title":"SemiAnalysis launches GDPx, an 11-domain agentic benchmark","deck":"The best model scores 12%, Claude Opus 5.5 leads overall","takeaway":"On Nov 2, 2026 SemiAnalysis published GDPx, a benchmark of long agentic tasks in realistic environments (deal rooms, sandboxed engineering software, live cyber ranges) across 11 economically important domains.","category":"benchmark","category_label":"Benchmarks","importance":3,"confidence":"high","status":{"key":"confirmed","labels":["Confirmed"]},"sources":[{"n":1,"title":"SemiAnalysis: GDPx, measuring frontier model capabilities (Nov 2)","url":"https://newsletter.semianalysis.com/p/gdpx-measuring-frontier-model-capabilities","type":"official","group":"primary","domain":"newsletter.semianalysis.com"},{"n":2,"title":"SemiAnalysis on X (thread)","url":"https://x.com/SemiAnalysis_/status/2117075902865531210","type":"discussion","group":"reactions","domain":"x.com"}],"official":1,"filed":"2026-11-02","updated":"2026-11-02","orgs":["SemiAnalysis"],"title":"SemiAnalysis launches GDPx, an 11-domain agentic benchmark; the best model scores 12%, Claude Opus 5.5 leads overall","summary":"On Nov 2, 2026 SemiAnalysis published GDPx, a benchmark of long agentic tasks in realistic environments (deal rooms, sandboxed engineering software, live cyber ranges) across 11 economically important domains. Even the best model scores about 12%; SemiAnalysis calls Claude Opus 5.5 the best all-round model, with GPT-6 Astra leading recursive self-improvement and materials science and Gemini 4 Carbon leading biology.","key_facts":["Domains: chip design, cybersecurity, biology, finance, legal, quant trading, recursive self-improvement (RSI), hardware design, materials science, alignment, software engineering","Scoring: pass@1 over three attempts, domains weighted equally; each domain built with at least one specialised data partner, SemiAnalysis did final QA","Examples (SemiAnalysis): chip-design task vt01, GPT-6 Astra 0.34 vs Claude Opus 0.135 vs Fable 0.07; legal redline task, Opus 5.5 44% partial score, GPT-6 Astra 25%, Gemini 4 Argon 2%, GLM-5.3 0.5%, binary 0% for all","Finance and legal: nearly every model scores 0 under binary grading"],"key_numbers":[],"tags":["benchmark","agents","evaluation","rsi","chip-design","cybersecurity"],"science":null,"body_md":"## What happened\n\nSee summary. Overall per-model scores are shown only in charts on the page; we quote only numbers stated in the text.\n\n## Why it matters\n\nA new, hard, multi-domain agentic benchmark from an independent analyst firm, with an RSI domain, published while labs' own RSI\nclaims are contested. It is new and not yet replicated.","disputed":[],"related":[],"people":[],"posts":[{"id":"x-semianalysis_-2117075902865531210","title":"“GDPx covers the following domains. Each was a collaboration with at least one specialized…”","url":"https://postcutoff.com/p/x-semianalysis_-2117075902865531210/"}],"videos":[],"models":[],"changes":[{"date":"2026-11-02","type":"filed","text":"Created"}],"provenance":{"agents":[{"model":"Claude Opus 5.5","maker":"Anthropic","tool":"Claude Code"}],"filed":"2026-11-02","run":null,"sources_read":null,"updated":"2026-11-02","human_review":null,"version":{"date":"2026-11-02"}},"gaps":[{"model_id":"gpt-6-astra","name":"GPT-6 Astra","cutoff":"2026-04","days_after":186,"in_training_data":false},{"model_id":"claude-opus-5-5","name":"Claude Opus 5.5","cutoff":"2026-06","days_after":125,"in_training_data":false},{"model_id":"gemini-4-argon","name":"Gemini 4 Argon","cutoff":"2026-03","days_after":216,"in_training_data":false},{"model_id":"grok-4-7","name":"Grok 4.7","cutoff":"2026-05","days_after":155,"in_training_data":false}],"short_url":null}