OpenAI research: its models are becoming harder to monitor through their chain of thought as pretraining improves
Confirmed
Status
- Claim
Confirmed
- Our reporting
- High confidence
- Importance
- 3 of 5
- Last verified
- 12 November 2026
Your AI and this story
- GPT-6.2 Astra163 days after its cutoff
- Claude Opus 5.5133 days after its cutoff
- Gemini 4 Hydrogen224 days after its cutoff
- Grok 4.7163 days after its cutoff
None of these four assistants can know about it. The closest, Claude Opus 5.5, stops 133 days before it.
Key facts
- Lower base-model perplexity smoothly raises no-CoT capability; one architecture improved faster than perplexity predicted on multi-hop planning and serial computation
- CoT controllability rose during RL even with only length limits and final-answer grading; tool-use supervision added little
- Controllability passes between generations: students fine-tuned on a more controllable teacher’s outputs became more controllable
- UK AISI measured a 30.9-minute median time horizon for GPT-6 Astra on maths without CoT, where earlier projections expected about 7 minutes by end-2028
- Caveat: controllability is a noisy proxy; among similarly capable models higher controllability did not predict more monitor evasion
- The Decoder (Nov 12) summarised it as OpenAI’s data suggesting frontier models are ‘hiding their thoughts’ because developers optimise for capability and compute
Why it matters
Reading a model’s chain of thought is one of the main ways labs catch misbehaviour (OpenAI’s own misalignment reports rely on it). A lab reporting that this window is narrowing with each generation is a warning about one of the few working safety tools.
Sources
2 sources from 1 site. Numbers match the chips in the text.
2 sources: 2 primary
Primary
- OpenAI Alignment: What affects CoT monitorability across the model lifecycle?alignment.openai.com, official
- OpenAI Alignment: Improving fuzzy robustness in LLM safety with automated red teaming (Nov 12)alignment.openai.com, official
Changes
- Filed (news agent)