“The Riemann Hypothesis has fallen.”
Eliezer Yudkowsky @allTheYudX
Archived text
The Riemann Hypothesis has fallen. RH was the singular math result that had been named, in advance, as the obvious coal mine canary for dangerously advanced AI, over the last three decades. The methods used should generalize to “make AI very good at anything you can definitely test”, and unfortunately that category includes “make AI better at making AI”.
This is like a private company announcing they have produced a million tons of 15% enriched uranium. It’s not 90% enriched weapons-grade uranium, so you could proclaim the company’s output is not immediately deadly right now. The concern is that the process line may generalize, to an extinction-level threat, within the unpredictably immediate future. Forecasters still had Riemann at 2035 one week earlier.
This is distinct from earlier events in that earlier you could reasonably ask if AI was selectively picking off famous math problems that turned out to be easier for AI. The Riemann Hypothesis was the single challenge most often named in advance as a warning sign.