Skip to content

OpenAI

OpenAI’s math claims expose AI’s verification bottleneck

AI-generated mathematics is exposing a verification bottleneck as OpenAI’s reported proofs arrive faster than experts can review them.

Abstract desk scene with blank papers, geometric forms, and a glowing network suggesting AI-assisted mathematics.
On this page

AI has entered a part of mathematics where the scarce resource is no longer just the proof. It is human digestion. According to WIRED, OpenAI convened about 40 mathematicians in August to discuss what should happen if AI systems outpace human capability in the field, while attendees say the company hinted its models had solved hundreds of long-standing problems.

That would already be a major governance problem. It is also a technical milestone. Ars Technica reported that in mid-May OpenAI announced an internal model had disproved the Erdős unit distance conjecture, an 80-year-old problem in discrete geometry. Fields Medalist Tim Gowers called the result “a milestone in AI mathematics,” while University of Toronto professor Daniel Litt described it as the first autonomously produced AI result he found exciting “in itself, as opposed to as a leading indicator.”

The tension is not simply “AI beats humans at math.” The sharper problem is that AI labs may be able to generate mathematical results faster than the mathematical community can verify, attribute, absorb, and build on them.

The WIRED report describes a widening conflict between frontier AI labs and professional mathematicians over process. OpenAI spokesperson Lindsay McCallum told WIRED that on August 28 the company began training a new internal model and that, in addition to “resolving the Navier—Stokes Millennium Prize problem,” the model had “resolved more than 100 long-standing open problems across most areas of mathematics.”

That is an extraordinary claim, and it sits in a fragile context. The Navier–Stokes problem is one of the Millennium Prize Problems, a class of problems whose resolution normally requires extended scrutiny from experts. We covered the verification stakes around that claim in OpenAI’s Navier–Stokes proof claim: the headline result matters, but the path from “model produced an argument” to “the field accepts the theorem” is the hard part.

WIRED also reported that OpenAI had told people it planned to release hundreds of solutions to unsolved problems on GitHub. McCallum told WIRED the company was “working to responsibly release” the next math results and was drawing on advice and public recommendations from the Advisory Group on Mathematics and Artificial Intelligence at the Institute for Advanced Study. She also said OpenAI had not set a release time.

That distinction matters. A GitHub release is useful for software. It is not automatically the right unit for frontier mathematics. Mathematicians can read code, formal proofs, outlines, and papers, but each format answers a different question. Does the argument work? Who had the key idea? What prior work does it depend on? Which parts are new, and which are recombinations? What should other researchers cite?

Bryna Kra, a Northwestern University mathematician who attended the August meeting, told WIRED that attendees asked OpenAI not to publish results only in a blog post or tweet, and instead to write papers that mathematicians could “absorb, digest, and use.” Kra told WIRED: “Apparently, that input was ignored.”

The unit distance result shows both the promise and the limit

Link to the section: The unit distance result shows both the promise and the limit

The clearest technical example in the source material is not the disputed batch of hundreds of results. It is OpenAI’s earlier unit distance result.

The Erdős unit distance problem asks, roughly, how many pairs of points in a plane can be exactly one unit apart. Paul Erdős conjectured that the best possible arrangement would grow only barely faster than the number of points. According to Ars Technica, OpenAI’s model proved him wrong by constructing a more complex point arrangement than the traditional grid-based approaches.

Ars describes the method as a clever recombination of known mathematical ideas. The model used a high-dimensional grid, projected it into two dimensions, and used algebraic integers to create richer structure. The result did not, in Ars’s assessment, introduce genuinely new techniques. Human mathematicians later cleaned up and extended the work.

That combination is important: autonomous enough to matter, but not magic. The AI system found a proof that resolved a major open conjecture, yet the result still needed human interpretation, simplification, extension, and placement in the literature.

This is the most realistic near-term picture for AI in research: models search broadly, connect subfields, and grind through proof strategies that would be tedious for people; humans decide which questions matter, repair the exposition, check the work, and build the next layer. That division may not hold forever, but the current evidence in the supplied reporting supports a hybrid story more than a clean replacement story.

It also resembles what engineers are seeing in software agents. The hardest production questions are not only “can the model produce an answer?” They are “can we evaluate it, reproduce it, attribute it, and safely let it act?” That is why evaluation design has become central, from small golden sets to repeated-run measures such as pass@k; if you want the engineering version, start with LLM evaluation.

Get new posts in your inbox

AI news, guides and product updates — a short email when we publish something worth your time.

The backlash WIRED reports is not anti-AI in the simple sense. Several mathematicians quoted in the story appear excited by stronger tools. Their concern is institutional power and scientific process.

WIRED writes that some academics feel mathematics has become a proving ground for OpenAI and Anthropic as the companies race to show model capability. Nestor Guillen, a visiting math professor at New York University, told WIRED there is “a perception of mobster behavior” among mathematicians toward AI companies. OpenAI’s McCallum responded: “We disagree with that characterization.”

The most serious dispute described by WIRED involves Tristan Buckmaster, a New York University professor, and Levent Alpöge, an Anthropic employee. WIRED reports that OpenAI deployed thousands of agents in September to work on a Millennium Prize problem after hearing “rumors” that others were close. Buckmaster accused OpenAI of front-running work he had done with Alpöge, work the pair had not yet published but had been using OpenAI tools to help develop.

OpenAI researcher Sébastien Bubeck denied asking for Alpöge to be excluded from authorship, according to WIRED’s account of his response. Still, the episode shows why attribution becomes difficult when researchers use proprietary tools, labs can observe some usage, and internal models can be pointed at adjacent problems at large scale.

The community is already responding. WIRED mentions Hexagon, a repository for primarily AI-generated mathematical material, and Palomar, a registry of machine-verified mathematics. It also cites the Leiden declaration, a call signed by more than 4,000 mathematicians asking AI companies to meet mathematicians’ standards.

The direction is clear: if AI-generated mathematics becomes abundant, mathematics needs new infrastructure for provenance, review, and verification. GitHub may be part of that. It cannot be the whole process.

The verification bottleneck is the real story

Link to the section: The verification bottleneck is the real story

A proof is not accepted because a powerful model emits it. It is accepted because a community can check it.

That social layer is easy to underestimate from the outside. Mathematics often looks like pure logic: either the proof is valid or it is not. In practice, a proof also has to be readable, contextualized, and connected to existing work. A field needs to know which lemmas are doing the work, which assumptions are hidden, which citations are missing, and which claims are strong enough to reuse.

AI stresses that system by changing the volume. One difficult proof is a challenge. Hundreds of claimed solutions are a queueing problem. If only a small number of experts can evaluate each result, releasing a large batch can create a backlog that looks like progress from the lab’s perspective and like debris from the field’s perspective.

For AI builders, this is the useful analogy: capability without review capacity creates operational risk. A coding agent that opens 200 pull requests can be less helpful than one that opens five reviewable ones. A research agent that produces thousands of candidate claims needs triage. A business agent that takes actions across tools needs approval points, audit logs, and rollback paths. The same pattern shows up in human-in-the-loop approvals and in long-running agent work where context, state, and oversight matter more than one impressive answer.

The math controversy is a preview of what happens when generation gets cheaper than evaluation.

Mathematics is an early stress test because it has unusual properties. Problems can be sharply stated. Proofs can sometimes be formally checked. Prestige is tied to solving named open questions. And the community has strong norms around priority, attribution, and publication.

Other fields will face a version of the same pressure wherever three conditions hold:

ConditionWhy it matters
Outputs are cheap to generateAI can flood the review process with candidates
Validation is expensiveExperts, experiments, courts, or users must still check the work
Credit mattersPriority, authorship, liability, or revenue depends on provenance

Software is already there. Code can be generated quickly, but correctness, security, maintainability, and ownership still require review. Scientific literature is close: an AI can propose hypotheses or analyses faster than labs can test them. Legal and medical work are more constrained, but they share the same asymmetry between fluent output and costly verification.

The lesson is not to slow every model down by default. It is to design institutions and systems around the bottleneck. If a model can produce 1,000 plausible artifacts, the product question becomes: which 10 should a human see, in what order, with what evidence, and under what constraints?

That is also the design center for practical agent systems. Multi-agent workflows need routing, memory, tools, and escalation paths, but they also need boundaries: what can run automatically, what requires review, and what gets logged for later inspection. If you are building in that direction, the engineering problems overlap with multi-agent orchestration more than with prompt cleverness.

The reporting points to a short list of norms that would reduce friction.

First, release papers, not only announcements. Blog posts can explain results, but they should not replace the scholarly object when the claim is a theorem.

Second, separate capability demos from scientific claims. “Our model produced this proof” and “the community accepts this result” are different statements. Keeping them separate protects both the lab and the field.

Third, disclose provenance. If AI tools were used by outside mathematicians, if a lab had access to user interactions, or if internal agents were deployed after hearing about competing work, the attribution story needs more than a footnote.

Fourth, use registries and verification infrastructure. WIRED reports that mathematicians have encouraged OpenAI to use tools such as Hexagon and Palomar. If those tools are not sufficient, labs should help improve the process rather than route around it.

Fifth, release at a human-reviewable cadence. A dump of hundreds of results may maximize spectacle. It does not maximize understanding.

The identity crisis, if there is one, is not that mathematicians no longer matter. It is that the profession may need to redefine its scarce work. Asking good questions, setting standards, verifying results, assigning credit, and turning isolated proofs into usable theory all become more important when machines can produce more candidate answers.

That shift is uncomfortable. It is also familiar. Every mature field develops filters when production becomes cheap. AI is forcing mathematics to build those filters in public.

For more clear AI news and practical guides, subscribe to the NeuraLIA Labs newsletter.

  • The central issue is not only whether AI can solve hard math problems, but whether the mathematical community can verify and absorb results at the same speed.
  • OpenAI has reportedly claimed major progress on long-standing problems, including Navier–Stokes and more than 100 other open questions, but acceptance depends on expert scrutiny.
  • The Erdős unit distance result shows a likely near-term pattern: AI systems can find important proofs, while humans still simplify, contextualize, and extend them.
  • Mathematicians’ concerns focus on process, provenance, attribution, publication norms, and the risk of overwhelming review systems.
  • The same generation-versus-verification bottleneck is appearing in software, science, law, medicine, and agentic AI workflows.

What is the AI verification bottleneck in mathematics?

Link to the section: What is the AI verification bottleneck in mathematics?

It is the gap between how quickly AI systems can generate plausible proofs or claims and how slowly experts can verify, contextualize, attribute, and reuse them.

Did OpenAI prove the Navier–Stokes problem?

Link to the section: Did OpenAI prove the Navier–Stokes problem?

OpenAI has reportedly claimed that an internal model resolved the Navier–Stokes Millennium Prize problem, but the article emphasizes that community verification is required before such a claim is accepted.

Why are mathematicians concerned about AI-generated proofs?

Link to the section: Why are mathematicians concerned about AI-generated proofs?

Their concerns include publication standards, authorship, provenance, priority disputes, and the possibility that large batches of AI-generated results could overwhelm expert review.

What did OpenAI’s unit distance result show?

Link to the section: What did OpenAI’s unit distance result show?

According to the reporting discussed, an OpenAI model disproved the Erdős unit distance conjecture by recombining known ideas in a useful way, after which human mathematicians cleaned up and extended the work.

Which fields could face the same problem next?

Link to the section: Which fields could face the same problem next?

Software, scientific research, legal work, and medical work all face similar pressure because AI can produce outputs quickly while validation remains expensive and consequential.

Get new posts in your inbox

AI news, guides and product updates — a short email when we publish something worth your time.


Created by

David Vicente Campos

Founder of NeuraLIA Labs & Co-Founder of MyRealFood

I'm a computer engineer from the University of León. I co-founded MyRealFood, where as CTO I built the app millions of people have used to eat better, and I founded NeuraLIA Labs, where I build AI products. Here I write about what I've had to understand along the way, as I wish someone had explained it to me.

More about the author

Published by NeuraLIA Labs.

Abstract fluid vortex with geometric proof structures and a glowing verification grid.
openai11 min read

OpenAI’s Navier–Stokes proof claim, explained

OpenAI says AI agents found a Navier–Stokes singularity and formalized the proof in Lean. The harder story is what happens next: review, credit, and the power of private agent swarms in mathematics.

Abstract software decision engine with branching paths, probability nodes, and glowing gates.
jev11 min read

Jev AI model is built for decisions, not prose

TypeSafe AI’s Jev is drawing attention because it treats software intelligence as a probability problem: choose the right branch, attach confidence, and avoid paying an LLM to write text when code needs a decision.

Put your AI to work today

Every model and every tool in one place. Start free, no card needed.