Study: in 32% of model pairs, the reasoning model with the lower list price costs more
Confirmed
The takeaway
A March 2026 paper by Lingjiao Chen, Chi Zhang, Yeye He, Ion Stoica, Matei Zaharia and James Zou ran 8 frontier reasoning models on more than 6,800 queries across 12 tasks.
Status
- Claim
Confirmed
- Our reporting
- High confidence
- Importance
- 2 of 5
- Last verified
- 6 October 2026
Your AI and this story
- GPT-6.2 AstraIn its training data
- Claude Opus 5.5In its training data
- Gemini 4 HydrogenIn its training data
- Grok 4.7In its training data
It happened before the cutoffs of all four assistants, so it can be in their training data.
Key facts
- arXiv 2603.23971, v1 Mar 25, 2026, v2 May 28, 2026: ‘The Price Reversal Phenomenon: When Cheaper Reasoning Models Cost More’
- 8 frontier reasoning models, 12 tasks (maths, coding, science, agentic), 6,800+ queries; 32% of pairwise comparisons show a price reversal, up to 28x
- Gemini 3 Flash: listed price 80% below GPT-5.4’s, but 38% higher actual total cost
- Same query: one model may use 900% more thinking tokens than another, or 10x more environment turns; repeat runs of one model vary up to 9.7x in thinking tokens
- Example cited in press: a frame-by-frame video task where Gemini 3.1 Pro finished in 85 steps for ~$1 while Gemini 3 Flash took 1,000+ steps, failed and cost ~$14
- WSJ (Oct 5, 2026): only 11% of 396 surveyed businesses could forecast their AI spending
What happened
The authors used Shapley-value cost attribution to break down why list prices per token mislead. Total cost depends on how many thinking tokens a model spends and how many tool or environment turns it takes, and both vary by an order of magnitude across models and even across repeat runs.
Why it matters
Enterprise AI budgets are increasingly token-metered, so per-token price comparisons can mislead. The paper resurfaced in October 2026 press about runaway AI bills.
Sources
4 sources from 4 sites. Numbers match the chips in the text.
4 sources: 2 primary, 2 press
Primary
- arXiv 2603.23971: The Price Reversal Phenomenonarxiv.org, paper
- Microsoft Research publication pagemicrosoft.com, paper
Press
Changes
- Filed from WSJ Oct 5 survey; our automated search had mis-tagged it as the robot-exposure story. WSJ article paywalled, figures from the Techmeme headline and GIGAZINE.