Chollet: is the jagged frontier "mainly math + code" pushed by RLVR?

Posted 00:13 UTC: "What if the jagged frontier is mainly math + code (which you can push arbitrarily far with RLVR), and everything else starts to plateau because it is still bottlenecked by human generated data?" He asks whether steady gains in non-verifiable areas come from higher general ability or only from new human data, adding "A lot of things depend on the answer". Follow-up at 00:17 UTC (https://x.com/fchollet/status/2107626212613034064): does G "emerge" from math + code RLVR? ~68k views. Not explicitly about the release, but posted in its wake and listed with it on Techmeme.

What if the jagged frontier is mainly math + code (which you can push arbitrarily far with RLVR), and everything else starts to plateau because it is still bottlenecked by human generated data?

Model performance in non-verifiable areas has kept improving steadily, albeit much slower than for math and code. But is that steady improvement a side effect of a higher G (itself driven by RLVR), or only a function of the amount of new human data getting injected into training (which is still continually happening on a massive scale)?

A lot of things depend on the answer to this question

views 75755 · likes 1027 · reposts 73 · replies 105 (at fetch time)

Archived 2026-10-07 via fxtwitter (unofficial).