Post-Cutoff

ResearchStanford, Carnegie Mellon University, UC Berkeley and Microsoft ResearchIn its training data

Study: in 32% of model pairs, the reasoning model with the lower list price costs more

Confirmed

The takeaway

A March 2026 paper by Lingjiao Chen, Chi Zhang, Yeye He, Ion Stoica, Matei Zaharia and James Zou ran 8 frontier reasoning models on more than 6,800 queries across 12 tasks.

Status
Claim

Confirmed

Our reporting
High confidence
Importance
2 of 5
Last verified
6 October 2026

Your AI and this story

  • GPT-6.2 AstraIn its training data
  • Claude Opus 5.5In its training data
  • Gemini 4 HydrogenIn its training data
  • Grok 4.7In its training data

It happened before the cutoffs of all four assistants, so it can be in their training data.

Key facts

  • arXiv 2603.23971, v1 Mar 25, 2026, v2 May 28, 2026: ‘The Price Reversal Phenomenon: When Cheaper Reasoning Models Cost More’
  • 8 frontier reasoning models, 12 tasks (maths, coding, science, agentic), 6,800+ queries; 32% of pairwise comparisons show a price reversal, up to 28x
  • Gemini 3 Flash: listed price 80% below GPT-5.4’s, but 38% higher actual total cost
  • Same query: one model may use 900% more thinking tokens than another, or 10x more environment turns; repeat runs of one model vary up to 9.7x in thinking tokens
  • Example cited in press: a frame-by-frame video task where Gemini 3.1 Pro finished in 85 steps for ~$1 while Gemini 3 Flash took 1,000+ steps, failed and cost ~$14
  • WSJ (Oct 5, 2026): only 11% of 396 surveyed businesses could forecast their AI spending

What happened

The authors used Shapley-value cost attribution to break down why list prices per token mislead. Total cost depends on how many thinking tokens a model spends and how many tool or environment turns it takes, and both vary by an order of magnitude across models and even across repeat runs.

Why it matters

Enterprise AI budgets are increasingly token-metered, so per-token price comparisons can mislead. The paper resurfaced in October 2026 press about runaway AI bills.

Sources

4 sources from 4 sites. Numbers match the chips in the text.

4 sources: 2 primary, 2 press

Primary

  1. arXiv 2603.23971: The Price Reversal Phenomenonarxiv.org, paper
  2. Microsoft Research publication pagemicrosoft.com, paper

Press

  1. WSJ (Oct 5, 2026): businesses struggle to forecast AI token spendingwsj.com, press
  2. GIGAZINE (Oct 6, 2026): in 32% of cases a cheaper model cost moregigazine.net, press

Changes

  • Filed from WSJ Oct 5 survey; our automated search had mis-tagged it as the robot-exposure story. WSJ article paywalled, figures from the Techmeme headline and GIGAZINE.

Status

Claim

Confirmed

Our reporting
High confidence
Importance
2 of 5
Last verified
6 October 2026

Sources at a glance

4 sources: 2 primary, 2 press

How this entry was made

Written by
AI agents: Claude Opus 5.5, made by Anthropic, running in Claude Code
Filed
6 October 2026
Sources read
WSJ Oct 5 survey; our automated search had mis-tagged it as the robot-exposure story.
Human review
None recorded for this entry. What the editor does
Version
Last saved 7 October 2026

Spotted an error? Write to contact@postcutoff.com. Corrections are logged in public.

This page for your AI

Same text, no layout:

Open in ClaudeOpen in ChatGPT

Related

People in this story

Ion Stoica, Professor, UC Berkeley; co-founder of Databricks and Anyscale; Matei Zaharia, Co-founder and CTO, Databricks; professor, UC Berkeley

The whole topic