SemiAnalysis Launches GDPx: Even the Best Model Scores 12%
Research firm SemiAnalysis released the agent benchmark GDPx v1.0 on Nov 2: 206 professional tasks across 11 domains, with Anthropic's Claude Opus 5.5 leading at 12.0%, Google's Gemini 4 Carbon second at 10.9% and OpenAI's GPT-6 Astra third at 9.6%.

What happened
Positioned as the successor to OpenAI's GDPval from September 2025, the benchmark was built with 14 specialist data partners and spans 11 professional domains and 206 tasks. On the debut leaderboard, Anthropic's Claude Opus 5.5 leads at 12.0%, followed by Google's Gemini 4 Carbon at 10.9% and OpenAI's GPT-6 Astra at 9.6%; the publisher is research firm SemiAnalysis and the release date is Nov 2.
Unlike question-answering tests, GDPx asks models to actually deliver work inside a simulated workplace: each task has a default limit of eight hours, and grading is pass-or-fail wherever possible, so a near-complete but undelivered result does not pass. The headline score averages each model's first-attempt pass rate over three attempts, with all 11 domains weighted equally.
By domain, Opus 5.5 leads quant trading, hardware design and chip design, Gemini 4 Carbon leads biology and software engineering, and GPT-6 Astra leads recursive self-improvement and materials science; finance and legal tasks score near zero for almost every model under binary grading. SemiAnalysis notes the totals for Opus 5.5 and GPT-6 Astra are depressed by safety classifiers refusing some cybersecurity, biology and alignment tasks.
Key facts
- Publisher and version: SemiAnalysis, Nov 2, 2026, GDPx v1.0, authored by Max Kan, Andrew Megalaa and Dylan Patel
- Scale: 206 tasks across 11 domains with 14 specialist data partners; domains include chip design, cybersecurity, biology, finance, legal, quant trading, recursive self-improvement, hardware design, materials science, alignment and software engineering
- Scoring: eight-hour default limit per task; the headline score averages first-attempt pass rates over three attempts, with all domains weighted equally
- Top three: Claude Opus 5.5 at 12.0% ($51.41 per task), Gemini 4 Carbon at 10.9% ($16.29), GPT-6 Astra at 9.6% ($53.99)
- Next ranks: Meta Muse Wonder Full 9.0%, Claude Fable 5.1 8.5%, GPT-6.1 Sol 8.4%, Claude Sonnet 5.5 8.2%, Gemini 4 Argon 7.3%
- Harness: each model runs in its native agent harness — Claude Code for Opus 5.5, Codex for GPT-6 Astra, Antigravity for Gemini 4 Carbon, OpenCode as fallback
- Update plan: SemiAnalysis describes GDPx as a living benchmark with new versions every 3–6 months
Why it matters
GDPx moves scoring from answering questions to delivering real work within eight hours, finance and legal tasks score near zero across the board, and the leaderboard measures frontier models by pass rate and per-task cost at the same time for the first time.
CompaniesOpenAI·Anthropic·Google
Follow HIMIAO Horizon
No sign-up · Unsubscribe any timeNotifications
A ping on your phone or computer when the brief is out. No email needed.
Comments
Related
- Sep 30Google Unveils Gemini 4 'Argon': Its First New-Generation Flagship Since Gemini 3
- Oct 30Four AI Labs Back a Shared Training Opt-Out Signal
- Oct 22Goldman Sachs Commits $500 Million to Launch Small Business AI Institute with OpenAI, Google, Anthropic and Meta
- Oct 22Claude Code vs Codex CLI vs Gemini CLI: Three Terminal Coding Agents Compared
- Oct 20Inception Launches Mercury 3: Diffusion LLM Exceeds 1,000 Tokens/Second With 1M Context
Today
Nov 4 Wednesday- Brief
- GitHubGitHub Weekly Vol.4: 6 Projects Worth a Look This Week
Tested or read — weeklyAll →
- Quiz
- Call
Latest news
All →- Nov 4Fal Raises $1.3B Series F at $16B Valuation
- Nov 4OpenAI Raises Bug Bounties: Critical Finds Up to $30,000, Exceptional Finds up to $172,000
- Nov 4CrowdStrike Signs Two Deals in a Day to Buy Fiddler AI and Dreadnode
- Nov 3NYT Sues Brave Over AI Scraping of Its Content
- Nov 3Anthropic Launches Message Threads for Long Agent Sessions
- Nov 3Anthropic's Amended S-1: $16.96B Q3 Revenue, $895.4B in Compute Commitments
™