Tao: Open math problems being non-renewably mined by AI (mathstodon.xyz)

367 points by _alternator_ 13 hours ago

senshan 8 hours ago

From "Jokester" by Isaac Asimov 1956:

"Early in the history of Multivac, it had become apparent that there was one big bottleneck: the questioning procedure. Multivac could answer the problems of humanity, all the problems, if -- if it were asked meaningful questions. But as knowledge accumulated at an ever-faster rate, it became ever more difficult to locate those meaningful questions."

[0] https://web.archive.org/web/20150118004835/http://www.sffaud...

nine_k 7 hours ago

I'd say that a more appropriate reference from that time would be "The Nine Billion Names of God" by Arthur C. Clarke [1], which actually deals with the finiteness of the list of problems that a machine successfully exhausts.

[1]: https://hex.ooo/library/nine_billion_names_of_god.html

bityard 7 hours ago

I don't see why that should be a problem, as we already know the answer is 42 in any case.

aethelraed 6 hours ago

There is as yet insufficient Data for a meaningful answer.

[1]: https://www.imdb.com/title/tt0708807

senshan 6 hours ago

TZubiri 6 hours ago

vessenes 12 hours ago

That’s not untrue. But it’s also a misstatement of mathematical history. Many leading mathematicians historically have been highly competitive — Gauss comes to mind. Woe betide the lesser intellect that sent Gauss some ideas. The Newton Leibniz controversy was very serious business at the time in the UK and the continent. It was considered at the least a sin to reveal that sqrt(2) was irrational to those outside Pythagoras circle.

Mathematics has always been highly competitive.

kzz102 11 hours ago

The mathematical community was very competitive in its early years, but in the last 70 to 100 years, it has been generally less competitive and very collegial. The community was in a good place, and progress has been very good. In a few cases when competitiveness was ramped up, it lead to bad behaviour and destructive fights. Few would like to return to those competitive years.

JumpCrisscross 4 hours ago

Maybe it’s a dynamic equilibrium? We will become competitive for a while, then run out of questions, which in turn rewards pockets of collaboration?

henryfjordan 12 hours ago

The story of the cubic equations is another great example: https://en.wikipedia.org/wiki/Cubic_equation

Dudes straight up used to hoard solutions to equations and use them in math battles.

free_bip 11 hours ago

Right, the point is we're trying to avoid reverting back to such practices.

-0_0- 10 hours ago

Showing my ignorance, but the only thing I can picture when I hear 'math battles' is akin to the 'street Countdown' scene from the IT Crowd

2b3a51 an hour ago

Andrew Wiles was also careful about communicating progress on his Fermat's Theorem proof during the years in his attic. So yes I take the point.

I read the Mastodon thread as more about the 'flattening' and 'rawness' of the proofs these systems and their operators are producing. I mean what is the cultural significance of a lean proof that is half a million lines long or something? And what tools can be extracted for further work from such a construction?

The late William Thurston wrote about the culture of mathematics in that sense.

connorboyle 11 hours ago

My computer contains the prime factorization of probably several dozen (if not more) large integers, and I refuse to share them with anyone!

(Because they are my private RSA keys)

mitxela 6 hours ago

Why are you still using RSA?

catlifeonmars 4 hours ago

gpugreg 3 hours ago

Jtariiiii 12 hours ago

Also Andrew Wiles working in secret for 7 years out of fear of someone scooping him.

dev_dan_2 12 hours ago

Partially; but also in order to be able to focus, as stated by himself in https://www.pbs.org/wgbh/nova/transcripts/2414proof.html:

"But I realized after a while that talking to people casually about Fermat was impossible, because it just generates too much interest, and you can't really focus yourself for years unless you have this kind of undivided concentration, which too many spectators would have destroyed."

But yes; him reaping the benefits of himself having the idea first was part of it too; as far as I am aware.

-----

Which is still something completely different than some anonymous organisation keeping mathematical research secret because it is better for hype reasons. One is competition between individuals or groups within a field; the other is boring and sometimes borderline nihilistic generating of mathematical knowledge as an marketing asset.

techas 12 hours ago

I've always found the story of A. Wiles sad and frustrating. He worked in secret for 7 years. He submitted a (incorrect) proof at year 4 or so. Reviewers found a problem, but he decided kept all secret for many years after. He didn't even proof the last theorem of Fermat directly, he proved some conjeture that someone else before him, proved that it implied Fermat last theorem...

I found this behavior against healthy science practices and only driven by ego. Unfortunately, I find this too often at work (working in academia). Most probably I'm too naive...

seanhunter 4 minutes ago

rockdoe 3 hours ago

Jblx2 9 hours ago

derangedHorse 12 hours ago

The_Blade 11 hours ago

rcxdude 10 hours ago

cozzyd 7 hours ago

   It was considered at the least a sin to reveal that sqrt(2) was irrational to those outside Pythagoras circle
perhaps a 2 sin 45?

segmondy 6 hours ago

You miss the point. Humans don't mind competing with others. I love competition, but I don't want to compete with you and your machine. I love to play chess, I don't care if you are grand master, whoop my ass. But not if you are going to pair up with stockfish. I don't even care if you are a newbie that started playing yesterday with an ELO rating of 900. If I wanted to play the damn computer I'll do it myself. Likewise, mathematicians will not mind sharing and competing with other fellows, but if another has a billion dollars worth of GPU and you don't? Then you best be carefully what you say.

p1esk 5 hours ago

Could you tell the difference between a grandmaster and stockfish if playing them online? If not, why would you care which one you are playing against?

hananova 5 hours ago

sh4zb0t 5 hours ago

itissid 6 hours ago

Yeah but a highly productive last two decades of math research from https://en.wikipedia.org/wiki/Polymath_Project has come from collaboration.

itemize123 7 hours ago

this is not untrue but it's a pendulum swinging back to ancient times man

easterncalculus 10 hours ago

Between people.

magicalist 9 hours ago

Surprised to see someone on HN arguing against open science. Seems like the opposite of the lessons we should learn from Newton and Gauss, actually, hoarding results for decades at the expense of progress.

(the Pythagorean thing isn't really competition either, is ahistorical, and from what we actually do know it's again people hoarding results instead of sharing them).

FWIW, your post comes off as a middlebrow dismissal, surface level and not actually engaging with the substance of the comment. It's also just wrong. You claim "it’s also a misstatement of mathematical history", but don't specify which part. That there's "centuries of traditions of open science"? But your examples are from centuries (and millennia) ago, and there was never any claim that these traditions are universal.

But more fundamentally, competition doesn't mean you can't also have open science. And the very long, damaging events like the Leibniz/Newton feud are exactly what make many mathematicians work to maintain a spirit of collaboration and attribution even when they're competing on approaches.

modemNoises 9 hours ago

Nothing in their comment reads to me as "arguing against"

Reads like nothing but historical context

magicalist 7 hours ago

Wissenschafter 8 hours ago

They aren't arguing against open science, they are trying to educate you on the history of science. It's always been this way.

Also, your third paragraph is highly ironic.

magicalist 7 hours ago

vessenes 6 hours ago

Not arguing against open science - it's super valuable. I'm saying that pearl clutching by people reading Tao isn't useful, because it misses some long history which tells us that this kind of science has been seen as fundamentally competitive for millennia.

Should it be competitive? Is it more useful to be collaborative? How collaborative can it be when it's fundamentally competitive? Is it only fundamentally competitive because of some common 'quirks' of math types, or are there deeper forces pressuring it to be competitive?

These are all questions that I think are worth discussing, as is the note that the pendulum seems to be swinging away from cooperation in the face of competing for $trillion+ valuations (and a real enthusiasm for proving cool math stuff). The alternative, tweeting complaints on twitter without some context, is mostly a waste of space. I mentioned the history in hopes we could get informed complaints on twitter.

Alien1Being 6 hours ago

Tao's central point seems to be:

"In short, the indiscriminate use of powerful solution-extraction tools can achieve the immediate short-term goal of solving problems at hand, but at the cost of sustaining the ecosystem for the next wave of progress, or in understanding the progress already obtained. "

I am no mathematician, may have misunderstood his point and would be delighted to receive any corrections.

Agentlien an hour ago

I definitely see what he is saying.

In my work as a graphics programmer I often find that I look at a problem and will immediately see how to solve it, more or less. But the devil is in the details and often nothing works unless you get every detail right. So you spend a lot of time coming up with complex solutions, then boiling them down to simpler versions. In the end you often end up with a fix which is short, simple, and seems obvious. But it gets a lot of subtle details just right and avoids countless potential issues you wouldn't know if you hadn't failed a lot getting there.

And that is actually how you learn and master the craft.

Now, imagine you describe how you sort of solve it to a machine and it spits out the simple, correct implementation and you nod approvingly, never knowing all the ways it could have gone wrong. If this is how mathematics - or programming - is done from now on, no one will actually master their craft. I definitely see why this would worry someone whose career is built on mastery of the craft and a legacy meant to teach the next generation.

oefrha 2 hours ago

One related problem I see is the pipeline for producing working mathematicians seems to have been completely and irreversibly decimated. What’s the point of doing a long and arduous PhD when all PhD level research problems that used to take months to years can be solved by far less talented people with $100/$1000/$10,000 to spare? How do you even select people into your program (this part is likely hypothetical, classical talent selection probably still works at the moment, but what about in a couple years)?

Disclosure: I did a theoretical physics PhD, but got admitted to quite a few top math programs back when I was applying to math and physics programs simultaneously. If you asked me whether I’d do a PhD today I’d say why bother.

Alien1Being an hour ago

Here most local STEM PhDs try to get into finance. This is largely due to lack of funding for science and poor opportunities for PhDs. Why be a poorly paid postdoc when Jane Street is offering a million USD signup bonus ?

PhDs from poorer overseas do try to get related jobs here, mainly to be able to get a permanent resident visa.

oefrha an hour ago

hn_throwaway_99 5 hours ago

Doesn't this seem to be where all domains are headed?

I get kinda freaked out when I feel like all the AI "utopianists" haven't taken the next logical step of thinking about what society looks like when humans are subpar in every domain (and you may argue this won't happen, though I'm becoming more and more a believer that it will, but my point is the utopianists believe that this absolutely will happen, and that it's also a wonderful thing). How motivated do you think folks will be to do the hard cognitive work to focus on things like math problems when there is a good chance AI will do it better?

znnajdla an hour ago

I don't think humans necessarily become subpar when AI can do most of the work. Taking my own personal example, I have far more intellectual curiosity and improved my skills in programming far more with Claude Code than for 15 years of programming without AI simply because I was bogged down by boilerplate and grunt work. Now that AI handles most of the boilerplate and grunt work and can handle harder and harder problems, I have the time and space to work on unexplored frontier problems.

So, no, my skills have not become subpar, but have only become stronger because of the presence of AI.

shakadak 23 minutes ago

ahepp 5 hours ago

Doesn't the premise that there's something inferior about these AI solutions, imply that there is something superior about human intelligence and that there will continue to be some kind of useful work for humans to do?

palmotea 5 hours ago

ramraj07 6 hours ago

Seems to be it, though Im not particularly concerned about this problem personally.

The fact that we all readily accept that modern AI systems can likely solve any math problem that no living genius can, tells me that no task is beyond this system we just need the right harness around it. The exhaustion of meaningful math problems to motivate mathematicians minds seems to be the least of my worries at that point.

Inb4 someone suggests that this is not proof that these AIs generalize, I agree thats a popular opinion, but both sides are merely that, with no possible way to prove. I will wallow in my existential dread while you do whatever it is that gives you comfort.

kkotak 6 hours ago

How is this any different from people in any field that are impacted by AI and lose the utility of their skills and endeavors over the past decades? Are we saying that we're running out of problems to solve because of AI and hence it should be stopped? I am not underestimating the importance of the collective knowledge of the mathematics community and the role of mathematics as the enablers of other sciences, but opposing meaningful progress in that discipline or any for that matter feels counter intuitive. I would rather have the mathematics community start collaborating closely with the this newly evolving and powerful tool to expedite humanity's progress.

hn_throwaway_99 5 hours ago

Do you see an end state in this? When AI is better than humans at everything (and I used to be very sceptical of that claim but I'm getting less and less by the day), I don't see the Wall-E version of humanity as some sort of utopia, and that's the good outcome.

IanCal 4 hours ago

His point is twofold: that the process of solving the problems leads to more than just solving the problem in front of you but other interesting things (he has an example of going on a hike to a waterfall and all the other things you might spot over in the distance or nearby on the way, which you’d miss if you were able to jump straight there), and also lots of the simpler open problems are ones early researchers learn on (this is akin to the “if we automate junior engineers how does anyone learn to be a senior?”).

dvt 11 hours ago

I'm with @nilesh on this one, and not exactly sure how merely the existence of a solution precludes the advancement of human knowledge. If a problem is "solved" (say, symbolically verified) without any insights gained, it doesn't seem very interesting to the profession.

Navier-Stokes is a bit different (because there's a prize attached, so "scooping" matters), but almost all interesting problems don't have any prizes attached.

torben-friis 10 hours ago

Humanity is very biased for the culmination of work, considering everything that comes before and after busywork for the lower masses.

Replicating a paper is just as valuable scientifically as publishing it, but how many careers advance through replication?

If we move the goal from "find the solution" to "clear up the LLMs work" that doesn't bode well neither for the attractiveness of the problem nor for the career of the professional that takes the challenge.

vikramkr 6 hours ago

> Replicating a paper is just as valuable scientifically as publishing it, but how many careers advance through replication?

A lot. In fields where knowledge is incrementally building on previous work the reason the whole field hasn't collapsed from the replication crisis is that usually the results that are really high impact are replicated in as an initial step in new research building on it. It's almost never the focus of the paper but you'll often find a quick mention in methods/supplemental of some previous work that was verified to be valid by a replication of a key technique etc. you'll have crisis where old tools are found to be problematic and findings end up revisited etc. Plus fields like clinical research where there's an awful lot of focus on replicating findings using staged clinical trials with increasing statistical power to determine if new interventions work - that's driven by regulatory requirements grounded in good science and a lot of people make careers in just that.

sdenton4 7 hours ago

In mathematics, finding novel proofs of a given result is often valuable; it may be a shorter proof (demonstrating better/expanded understanding of the problem) or a translation of the problem into a new domain, setting up more cross-domain advances.

derektank 10 hours ago

>Replicating a paper is just as valuable scientifically as publishing it, but how many careers advance through replication?

I don’t think this is true, especially for novel or unexpected results. I suppose it depends on what you mean by scientifically, and there is a debate in the philosophy of science about what the value of research even is, but a successful replication does not result in substantial updates to one’s beliefs in the way new research does. And if the goal of science is to change our beliefs and bring them closer to what is “real”, successful replications can’t be as valuable as the initial research almost by definition.

Retric 9 hours ago

pixl97 7 hours ago

lanstin 5 hours ago

marcus_holmes 8 hours ago

N_Lens 6 hours ago

I find that to be an issue of maturity (focusing only on the climax and not the process). In Japan, where I live, the culture has a greater appreciation for the context & process, not just the moment of victory.

If you examine the consequences of the inversion of the peak, you realise the need for a balanced perspective.

dbmikus 8 hours ago

An AI-generated solution always provides two pieces of info:

    1. proof that there is a solution
    2. a solution that you can work backwards from to build understanding
Maybe the solution is pretty inscrutable, but it's almost always better than nothing.

So, both of these pieces of info would be at least marginally useful for advancing human knowledge.

evenhash 7 hours ago

> An AI-generated solution always provides ... proof that there is a solution

This is only true in the most trivial sense. A solution is a solution, sure... but how do you know it's a solution, and not an incoherent jumble of words? A human has to review and vouch for it.

Just because the AI gives you an arxiv-worthy PDF, or a Lean proof which compiles, doesn't mean it proves what the AI says it does. The AI could give you the same PDF/Lean code and says it proves the opposite, how would anyone know the difference?

You can't advance human understanding unless you produce things that humans can understand.

vikramkr 7 hours ago

palmotea 4 hours ago

nine_k 7 hours ago

pixl97 7 hours ago

cobbal 6 hours ago

This is definitely true in an information theory sense: having more knowledge is always better than less knowledge. However, it may not be true in math as a social human endeavor, and having answers without interesting paths to get there may not expand human mathematics in the same way.

If Fermat had a book with larger margins, would Weil have devoted so much time to proving the Taniyama-Shimura conjecture? No one can say.

sashank_1509 8 hours ago

It demotivates mathematicians. That’s a pretty large negative!

dayjah 7 hours ago

apetresc 8 hours ago

rzerowan 7 hours ago

More of a 'its the journey' rather than the destination type of thing.Since the insights , quirks, tricks and procedures gained along the way allows insights intoother at that moment unknown problem/domains in the future.

As far as researchers sharing their data/notes with the AI hyperscalars looks like that would be coming to an end wihth a mor guild-like structure going forward to prevent their progress being fron-run by the AI labs.

bityard 7 hours ago

I wonder if it would be possible for researchers and scientists to submit their papers to an organization which would then collect them, submit them for peer review by other experts in the field, and then release them in periodical form ONLY to individuals and organizations who pay a subscription fee in order to read them while suing those who try to redistribute them without permission?

monkpit 7 hours ago

tmp10423288442 6 hours ago

Why would society fund mathematicians if they decided to become a guild that hides secrets? They could pursue that as a hobby, but they’d end up like the coders who refuse to use LLMs - rapidly becoming irrelevant and a bit sad from an outsider’s perspective.

rzerowan 2 hours ago

BeetleB 11 hours ago

Mathematicians will be less likely to work on a problem if there is a solution - even an incomprehensible one.

dvt 10 hours ago

> Mathematicians will be less likely to work on a problem if there is a solution

Yes, that is Tao's premise, I'm just not sure I buy it. Suppose an oracle existed which could answer any question truthfully. Let's ignore the mechanics of this for now, but it could say things like "the Riemann hypothesis is False" or whatever and we would take it as gospel.

Does this mean that we wouldn't have mathematicians or physicists or computer scientists or biologists anymore? I genuinely don't think so.

nafey 10 hours ago

monktastic1 10 hours ago

onetimeusename 6 hours ago

applicative 10 hours ago

_alternator_ 10 hours ago

drusepth 4 hours ago

Yes, but presumably they'll work on another problem instead, because they're mathematicians who enjoy doing mathematics.

Is there value lost in them working on problems that don't have solutions instead of problems that do?

mzs 5 hours ago

AI companies don't share the dead ends and only sometimes a bit of the process toward success so people don't understand what was curious along the way.

blantonl 8 hours ago

Why was there a prize attached to this problem then? What does humanity get out of this being proved?

monkpit 6 hours ago

This is my question too. If we are all just going “well that sucks” after AI solves this problem, why did anyone care about the problem being solved in the first place?

Is the bummer that we got a solution we didn’t want - that navier-stokes is not always applicable or something, but we hoped it was?

inkysigma 5 hours ago

pickleRick243 6 hours ago

Honestly, the attitude of the math community is a bit cringe and increasingly I think some of the elite/mystical aura is fading. Rather than a rich fertile jungle where AI can barely chomp through a fraction of the luscious terrain, one gets the sense it's a desert and all the oases are running dry.

dgellow 5 hours ago

The millennium problems is something done by a single institute to motivate progress on known open problems: https://en.wikipedia.org/wiki/Millennium_Prize_Problems

drusepth 3 hours ago

Ar-Curunir 8 hours ago

Current career structure of mathematicians works partially by looking at whether they have solved novel and interesting problems, or at least done theory-building that can help solve such problems. Many mathematicians are also motivated by being the world's first to solve such problems

Removing this measure suddenly means that academic mathematic norms need to adapt rapidly, and, even more importantly, intrinsic motivation for many mathematicians needs to change rapidly. That is understandably a sea change for the current mathematics community.

vkou 5 hours ago

> and not exactly sure how merely the existence of a solution precludes the advancement of human knowledge.

You'd be more sure if you read the tweets.

Tao's point is very simple.

1. Working on problems that AI solvers can solve is a waste of human time.

2. We have no idea which problems can be solved by AI solvers...

3. ...Because the AI labs are keeping their negative results secret, and don't tell us which problems they've tried and failed to solve, and why they've failed to solve them (or succeeded at solving others).

There are additional points surrounding it, but that is the thrust of his argument. His issue is not the existence of AI, but the anti-scientific secrecy in how it is used to solve problems. All the incentives around its current use result in closed, uncollaborative work - which while very attractive to a vulture capitalist, is anathema to scientists.

---

He also posits that having a solution to a problem is a small part of the value of solving a problem. What the AI labs are doing is the equivalent of a student turning in their homework, which has 100% of the right answers, but with none of the 'show your work' steps. Those steps are a critical artifact for doing mathematics, because the process of solving a difficult problem teaches us things about other problems.

nullbio 5 hours ago

There's nothing that AI won't be able to mine and accomplish (aside from being literally human), it's only a matter of hardware and scale at this point. Generalized problem solving is a factor of search efficiency over the problem space. The actual software part is all figured out, the only open questions are how to do things efficiently and what the trade-offs are from a hardware perspective, but if hardware paradigms are unlocked then efficiency becomes a secondary factor for the problems we care about. Why bother making an LLM twice as fast if you can make a chip that can process 100mil TPS, for example. You're already in a ballpark where it can do anything you want, with plenty left to spare.

The awkward part about all of this is that we're about to enter an age of extreme enslavement at the hands of the major tech companies if we do not focus on distribution of hardware and research, so that everyone can participate in the abundance and automate their daily lives. If we're beholden to frontier labs because they have hoarded all of the cutting edge hardware and we're left with overpriced scraps, we're collectively screwed. They will ensure a false economy is maintained so they can clutch onto a permanent class hierarchy of haves and have-nots and remain the key global decision makers. Automating hardware manufacturing is irrelevant if the hardware is not being distributed fairly, and is weighted to real scarcity instead of artifical scarcity.

Take Louis Vuitton for example. They can mass-produce their products for pennies, but they're artificially scarce and incredibly expensive. Imagine if ALL clothing was the price of LV. Now imagine this applies to every single thing you can purchase (or rather, rent - if some of these "elite" get their way), because they've cooked the economy and swallowed all industry. That's where we are headed if distribution and decentralization is not a priority for the world and we let labs like Anthropic pull off their regulatory capture stunts.

timr 4 hours ago

> There's nothing that AI won't be able to mine and accomplish (aside from being literally human), it's only a matter of hardware and scale at this point.

Sure there is: problems that require knowledge that simply doesn't exist yet. Until "AI" turns into general purpose robots that can develop new tools to explore the world, it is, in fact, pretty damned limited in what it can do without human help. The world is vast. Math is small.

Biology is replete with examples. Computers "solve" protein folding [1], and midwits immediately leap to conclusions that drug development will also quickly fall. But we literally have no idea how most of biology works, and simply getting to the starting line for drug development problems is often 95% of the battle. Come talk to me when you've done a million experiments to find the fundamental knowledge that unlocks the pathway(s) we didn't know about that makes a drug discovery program possible in the first place [2].

I am not pessimistic about humans running out of challenges. We'll just declare one class of problems "done" [3], and move on to the next frontier, as we always have. The problem with AI doomers is that they lack imagination that extends beyond computers, or perhaps more accurately, are so sophomoric in their thinking that they skip over the hard parts of any problem they don't fully understand. This stuff reminds me of the endless smartypants whinging about the end of human intelligence when chess machines started beating grandmasters. Chess was never really that great a measurement of human intellectual capacity, and we found new things to do with our big monkey brains.

[1] They did not solve protein folding, except in the minds of people who don't fully understand the problem.

[2] ...and invented new machinery to make the experiments possible in the first place.

[3] ...and we'll likely be wrong about that.

xigoi 4 hours ago

> it's only a matter of hardware and scale at this point.

The AI companies have already bought up the world’s entire supply of hardware. There won’t be any more.

20k 11 hours ago

We're having to rediscover in real time the extremely hard way, why enabling mass theft is so incredibly damaging to society. This is literally why we need a functional copyright system

If theft becomes more profitable than genuine creation, then nobody will create anything. Then there's nothing to steal, at which point all progress collapses

paxys 8 hours ago

What theft? LLM output has never been copyrightable.

_alternator_ 8 hours ago

I'll give you the benefit of the doubt. GP was referring to the use of copyrighted material to train LLMs.

orangecat 8 hours ago

paxys 7 hours ago

ralph84 8 hours ago

Nobody owns math and it is ridiculous to suggest someone should.

zer00eyz 6 hours ago

> why enabling mass theft is so incredibly damaging to society. This is literally why we need a functional copyright system

What is interesting is that LLM's do not directly violate copyright. The settlements we have seen are for how the works were acquired (that was a copyright violation) not the use of the works.

The vectors of a book, or a paper, are not the paper. They are, for all intents, facts about the work itself, and more generally writing. You can not copyright a fact.

It also means that the weights, the things that (mostly) matter can not be copyrighted either.

CamperBob2 10 hours ago

This is literally why we need a functional copyright system

To block progress. Got it.

20k 10 hours ago

This is the literal opposite of progress: stealing from people genuinely creating, and stealing the money they should earn

CamperBob2 9 hours ago

thymine_dimer 10 hours ago

Doesn't this just suggest that the next frontier for powerful AI models is to ask challenging questions, not simply solve them?

Terry even says this: "In fact, it is now the identification of a promising problem which is the scarce and precious resource."

The creativity and insight needed to ask a question that Terry gets excited about is the next step. Perhaps OpenAI should create a set of challenging questions and offer a prize to solve them.

qlte 10 hours ago

The incentives are massively skewed towards the AI labs investing their massive amounts of compute into being the first to solve an outstanding problem.

It's a marketing game for them, any societal benefits are secondary. Winning a prize is going to get headlines and feed into the "AGI soon, machine replaces another career" narrative they crave unlike coming up with some (possibly) interesting problems.

pictureofabear 9 hours ago

I think the problem with AI asking questions is that it will ask questions that are interesting to it but not necessarily us. AI, as a model, will never be a perfect copy of a human. It will always be a simulation, and thus to some extent, will ask questions that humans find irrelevant and solve problems that humans find irrelevant.

For anyone facing an existential crisis on AI, your ace in the hole is your humanity. Only you have it, and only you will be the best judge of what is good and interesting (to a human at least).

pixl97 7 hours ago

>your ace in the hole is your humanity

Average HN Poster: [nervous sweating]

alex_suzuki 7 minutes ago

roywiggins 10 hours ago

If AI can generate questions and then answer them, what are the people for?

gowld 10 hours ago

If humans can shovel dirt, then what are the ants for?

roywiggins 10 hours ago

matt3210 5 hours ago

> ask challenging questions

As far as I can tell, it's still not possible for an agent to reliably determine if a question is a good question. That means the test part of the loop cant be fulfilled.

bwfan123 11 hours ago

It is now clear to me why the AI labs are sponsoring these mathathons: https://mathathonchallenge.com/. They are basically crowdsourcing human researcher data to get access to promising directions possibly later to scoop others.

throwaway1707 10 hours ago

Not so dissimilar to my first comment on this site (which I got piled on): https://news.ycombinator.com/item?id=48959395

Except way more nefarious than I expected

jfengel 10 hours ago

I didn't realize that open math problems were a finite resource.

I recall a story about some famous mathematician (Gauss?) dismissing interest in Fermat's Last Theorem claiming that he could crank out problems of equivalent interest.

Clearly Tao knows a hell of a lot more than I do about this, but I'm surprised that math that close to completion.

porcoda 10 hours ago

They aren't, but the problem is that open problems tend to emerge when people are working on other problems. If fewer people are spending time deeply thinking about current problems since a handful of labs are solving them with AI without an eye towards understanding and only on verification, the pool of open problems won't be continuously growing. There is a fear that there will be a chilling effect on the community if people are disincentivized from trying to solve deep problems or study them for understanding as opposed to simply focusing on verification. It's more of a social and community problem than a fundamental problem with mathematics itself becoming "completed".

hkalbasi 10 hours ago

So we can let the ai generate some math problems based on the solutions found? Other fields (computer science, physics, ...) can generate math problems too.

mlyle 10 hours ago

esteban0x 6 hours ago

That explains a lot on why his arguments always focus on the "social part"

ryoshu 9 hours ago

tl;dr - it's content creation rather than process and understanding

nilkn 10 hours ago

It's easy to come up with new open problems. It's hard to come up with new open problems that seem to teach us something fundamentally new about the world. Our current batch of problems went through a complex selection process over decades (or centuries) based not purely on difficulty but also on perceived insightfulness.

I studied math, but I am not a mathematician, so I think I have a slightly different perspective on this than Tao overall. This is certainly the definitive end of an era in mathematics, but I think he's wrong that insightful new open problems are truly non-renewable. They might be non-renewable by humans at the rate at which they are being closed, but I see no reason why AI systems could not also discover insightful new open problems. In fact, once we have Riemann-capable AI mathematicians, I'd personally love to see what the next Riemann hypothesis is, which even these AI systems cannot solve with any amount of available compute.

I think we're about to find that, on the spectrum of mathematical intelligence, the best human mathematicians were only a fraction of a percent forward from the very beginning, and there's a vast universe of mathematical depth that's beyond our ability to imagine or work on directly in any way. We're used to feeling like we're able to directly perceive the Platonic realm, but we're almost certainly going to discover that our own minds, even when joined together over centuries of deliberation, can only interact with a tiny little shadow within it.

bee_rider 9 hours ago

I haven’t been following the AI proof stuff very closely, but the impression I got was that these models are producing massive Lean programs that prove the statement one way or another, but are quite difficult to fully understand.

Actually, I have to admit I don’t really know what math is. With physics we suspect there’s a universe, and when we study physics we’re improving our description of the behavior of that universe, right? The universe exists whether or not we know how it works.

Eventually, as you suggest, maybe we’ll hit math that won’t fit in anybody’s head at all. What is the nature of mathematics that doesn’t fit in any human’s head? Does it even exist in some sense?

nilkn 5 hours ago

pixl97 7 hours ago

tmp10423288442 6 hours ago

esteban0x 6 hours ago

What you are saying implies that by some technique that hasn't been discovered yet, we can make the models to have the capabilities of extrapolate the information they are trained on and also interpret that what they are extrapolating are Riemann-capable hypothesis. I do believe it will accelerate the discovery of that "vast universe of mathematical depth that's beyond our ability" but at the cost of removing the "fun part" of solving the problems. Not sure if the community is willing to do that.

wrsh07 8 hours ago

I'm surprised nobody has stated the obvious: a hard math problem that has been open for ten years (because many serious people have given it serious thought and been unable to make significant progress) is, in fact, nonrenewable.

The only way to renew it is to make a new problem that is so hard systems and humans will be unable to solve it for the next ten years. And, in the spirit of trees, the best time to plant a tree is twenty years ago, the next best is today: we do need to start posing some hard math problems and deciding if they are interesting merely because there are challenging or because of something else (eg busy beaver problems are arbitrarily hard, but does solving them imply anything other than "another busy beaver problem was solved"?)

pixl97 7 hours ago

Eh, if AI quickly solves most of our mathematics problems that are solvable then it might be time for us to hang up our hat as our little monkey brains aren't very good at this stuff.

Now, I think AI will solve some, but we'll find out that some are just either unsolvable or wildly huge that nothing is solving them any time soon.

And a whole lot of these problems have been around quite some time, when even knowing how to do advanced math meant you were a landed gentry or someone of high wealth. If those problems fall, they fall. They aren't pets we keep around forever. And new problems will crop up over time for both AI and men to scratch their brains over.

_alternator_ 10 hours ago

I think "close to completion" is not the right framing. Creating good open problems was an achievement because these problems often sit at the edge of known techniques, and solutions require inventing "new math". It's hard to find these problems, and they take decades to mature as they withstand scrutiny by many people.

In another comment below, I likened this to clear-cutting a forest. Growing the forest takes a lifetime; destroying it could happen in the next few months.

pitchlatte 10 hours ago

his whole point is that specifically problems that have been held as important by consensus in the field are a finite resource. obvious example being the Clay millennium prize problems. seems like they function to shape the direction of future research into useful directions. which is to say, the process of developing a solution itself generates more useful problems.

of course thrrr are tons of problems once you remove this social consensus based filter. if i’m not mistaken Ramanujan left a book of dozens of unproven theorems, for one quick example. i don’t think that that has opened up dozens of fields of mathematical research.

gowld 10 hours ago

> the Clay millennium prize problems

augmented Hilbert's problems of 1900.

Surely mathematicians are creative enough to ask new questions?

If not, then the next set of challenges will be to find questions to ask!

dgellow 5 hours ago

pvillano 8 hours ago

Deforestation might be a better metaphor than mining. Logging is renewable if for each tree you chop down you plant several more. AI companies are operating "in a non-renewable fashion" by chopping down trees without planing seeds. Open problems are a renewable resource, but only if harvested sustainably.

cool_dude85 10 hours ago

Relevant, interesting problems that we have some immediate hope of making genuine work on might be, if not finite, quite difficult to produce. And it's also plausible that AI will not do as good a job of producing these as it does at solving them.

The other problem that Tao identifies is that math has typically been an unusually open subject in many respects. This openness may not work if big AI labs can afford to throw $X million at a problem to scoop you if the rumor gets around that you think you have something promising. Hence, less collaboration, and less chance of identifying these exciting new problems, infinite though they may be.

agnishom 9 hours ago

> I didn't realize that open math problems were a finite resource.

That is exactly what Tao is explaining in that tweet.

TLDR: Open Problems are infinite, but those which are at the boundary of easy and hard problems and are interesting are far more scarce

mellosouls 9 hours ago

He addresses your point in the first paragraph.

gowld 10 hours ago

> I didn't realize that open math problems were a finite resource.

There's an interesting commentary about this: https://mathstodon.xyz/@tao/117237320796901560

> famous mathematician (Gauss?) dismissing interest in Fermat's Last Theorem claiming that he could crank out problems of equivalent interest.

Web search turns up Gauss's comment, with a bit more nuance: "I confess that Fermat's Theorem as an isolated proposition has very little interest for me, because I could easily lay down a multitude of such propositions, which one could neither prove nor dispose of." (https://mathshistory.st-andrews.ac.uk/Biographies/Gauss/quot...)

Ar-Curunir 8 hours ago

You can indeed generate many nonsensical problems. Generating ones which require interesting and non-trivial mathematics is much more difficult.

applicative 10 hours ago

I think you can't have read the thread. The whole point is that there is no end of mathematics, an infinite sea; but the constitution of an 'open math problem' is a delicate piece of mathematical thought, at any moment a small supply of drinking water developed by finitely many human being.

twotwotwo 8 hours ago

This is worsened by OAI/Ant's strategy of grabbing the glory and running rather than spending effort trying to to advance understanding of math. Tao, who is quite sophisticated in use of AI, has said a lot about this, including in meme form: https://mathstodon.xyz/@tao/117068266026618494

The AI labs' approach to math is immature in a way they can't get away with in coding. In coding, they realize that a pile of code that technically works is not enough: they need the code output to be a foundation to build on, and they need their agents to work well with humans which means explaining things in a way that makes sense.

In math, their goal seems just to be to exploit mathematics' reputation as full of hard problems with a general population that can't tell a pile of Lean from a good proof. OpenAI pretty much said this work is just to show off at the end of the post. Anthropic said their FLT formalization is a research artifact they do not intend to clean up or improve in any way.

Besides uniting mathematicians in irritation at the labs, the other flaw with this strategy is that it ignores that organizing knowledge is part of intelligence, much like not just producing a mess that runs is part of programming. You can write a proof that uses algebraic geometry because someone organized what could have been a bunch of disparate ideas (or fragments of a Lean repo no one will read) into a toolbox where an expert can find the tool they need.

I hope they change tack. Perhaps instead of making an explicit strategy of taking the credit from mathematicians but doing little for actual understanding, they could let some math departments at their swarms or best models, ask for a bit of acknowledgement, and hopefully they approach it by trying to write good papers, simplify, etc. rather than just rushing for headlines. (Tao's post about digesting an LLM-generated proof https://terrytao.wordpress.com/2026/08/12/a-digestion-of-the... is an interesting read for a sense of what he means by 'digestion'.)

On that last note, it's also important (Tao's also noted) for the mathematical community to properly value digestion and organization of results, so that given the incentives of mathematics and availability of new tools you end up with good papers and textbooks and so on, not just mathematicians taking the labs' current role of pushing incomprehensible-even-to-specialists proof code to repos.

kccqzy 8 hours ago

Besides Sendov’s Conjecture, Terence Tao has also shared his AI-assisted digestion of the counterexample to the Jacobian conjecture. In simple words, digestion just means full human understanding of the results. It could come from understanding the result from a different perspective, or perturbing the result and seeing what breaks.

twotwotwo 7 hours ago

The Jacobian one is great, and fits here -- 1) the counterexample came out as a tweet of a single expression which seems exceptionally hard to turn into something sensible, which crystallizes the lab's approach; 2) it links (like the Sendov post) to a chat transcript showing a little of what was involved in untangling it (though of course all that went into asking the right questions is invisible!).

For other folks, the post: https://terrytao.wordpress.com/2026/07/21/a-digestion-of-the...

The transcript: https://chatgpt.com/share/6a5fdc7a-d6f8-83e8-bbea-8deb42cfed...

ozgung 12 hours ago

No matter what happened this must be a wake up call for all of us. We’re basically sharing everything we have with these companies/AI systems. This is wildly different than a human wiretapping our private messages. Because it is systematic and automated in an astronomical scale. There is no real privacy in this new world. Law? I think “National Security” is a good enough excuse to screen anything constantly, including foreign researchers in case they are close to a breakthrough.

GolfPopper 12 hours ago

>We’re basically sharing everything we have with these companies/AI systems.

My sense of the word 'share' is that it traditionally involves agency by all parties involved. There are a lot of words in English for describing taking things without permission and profiting thereby - words like piracy, banditry, and larceny.

crisnoble 11 hours ago

Next you will try to tell me that these companies built upon nothing but piracy, banditry and larceny would continue to commit piracy, banditry or larceny.

_alternator_ 11 hours ago

This series of posts by Terry Tao is a direct response to the Navier-Stokes results (multiple results!) from the last 24 hours. The question is what is left after the levelling of mathematics, in all its senses, occurs? How can you protect a field that's under this much pressure in the next 6 months?

> [I]t is now the identification of a promising problem which is the scarce and precious resource. We have now seen that even the rumor of someone working on a problem can trigger a massive amount of AI-powered effort to flatten it before the original research project has time to reach its full potential.

ModernMech 11 hours ago

If math is solved then move to an area that’s not. Why do fields need “protecting” from ai?

dgellow 11 hours ago

Have you read his tweets?

ModernMech 11 hours ago

srcreigh 10 hours ago

Math can never be fully solved by a computer, if only for lack of computational resources.

pixl97 6 hours ago

vouaobrasil 11 hours ago

The reason is because the entirety of society, historically, has been based upon humans using their differential skills to further it, which in turn promotes societal cohesion. If most human endeavours are solved, then we will enter a period of abundance that paradoxically will erode the glue holding society together. In short, endless abundance of solutions and ideas cannot coexist with a healthy society. Only those who are priveleged and have a naive belief in a Star Trek utopia think otherwise.

hackinthebochs 10 hours ago

zamadatix 10 hours ago

pixl97 6 hours ago

calvinmorrison 11 hours ago

> How can you protect a field that's under this much pressure in the next 6 months?

Sounds like they're going the way of the DoDo. better take that PhD, migrate to the new world and become a tuktuk driver.

olalonde 11 hours ago

Can't mathematicians still gain novel insights by reverse-engineering AI-generated proofs? Just like chess players learn new concepts by studying what engines play.

_alternator_ 11 hours ago

Yes, and they will. But what's happening here is that the system that cultivates mathematics (and mathematicians) is recieving likely the biggest shock of its history. How do you reward merit and identify talen when people can't absorb the number of proofs being generated, much less understand them? Perleman's proof of the Poincare conjecture took several years for the mathematical community to digest; the proof of Navier-Stokes will probably take a similarly long time. In the mean time, it looks like all open problems will be solved (or proved that they can't be solved).

It's not that the horizon is expanding because of this. It's more like a forest getting clear-cut.

layman51 10 hours ago

This reminds me of the time an AI was taught how to play a racing sim game (Gran Turismo if I remember correctly). The AI was able to race its car very well, but it took a lot of risks that a human player probably would not. A human player might be able to copy the approach the AI took, but they would probably crash.

Going back to chess, I think the situation is similar where you can’t expect an amateur player to get better by trying to play like a strong engine. I think even professional chess players mainly use engines to prepare or memorize variations that are counterintuitive for their opponent. In other words, getting into situations that look wild, but that part of one player’s preparation.

I’m not sure how it is in math, but in chess, it seems like top players can play just like engines when they are in “normal” positions, so that is where I get a bit confused as to where the direction of insight is coming from because it’s been my view that AI is able to make leaps that we would never think of taking and I’m not sure that anyone could actually learn how to do that on their own unless they were willing to keep failing over and over.

marsten 5 hours ago

augment_me 7 hours ago

Well maybe its time to pivot from mathematics, and science as whole from personal attribution to being about progress of the field? Maybe your contribution to humanity as a mathematician is to find the right meaningful question to ask, and not to stamp your name on some fact?

marsten 5 hours ago

akoboldfrying 6 hours ago

johnsmith1840 10 hours ago

So what happens to this world view when AI not only clears the forest of problems we couldn't solve but also in the future discovers more forest with trees bigger than anything we've ever seen before?

Not sure what the point of this argument is. Do we have mathematics for the sake of mathematicians good mental health and career or to solve and discover novel problems? Why should we care if mathematicians can understand proofs if they are correct?

If this is V0.5 of AGI/ASI then by V1 the only system that will be understanding any of this is the AI itself. If AI creates a new field of mathematics month 1, then solutions to new problems in month 2, then another field of mathematics on top of that at month 3 there's no human who will ever keep up with that.

Or the alternative is a flattening of abilities, the AI cannot proceed further than the collective intelligence of humans and in that case this is correct. We'd be in a future where nobody wants to work in a field with an AI dominating it and when AI hits the limit of no useful training data input we'd have this giant gap of nobody know wtf it's done for years and nobody willing to figure it out and advance it.

Ooo here's a dytopian story: - AI gets better at everything humans do - humans stop trying - AI cannot improve anymore than its input data + human support - AI slowly degrades itself (model collapse) for decades, it slowly hallucinates little by little until its hallucinating entire scientific fields losing quality over time - there's a mass population of people in the future who never learned to do anything and now have to relearn and figure out the equivalent of 100k years of AI work in order to prevent its slow degredation while all the systems they've come to rely on start failing around them. The AI has solved every problem but every real solution is saturated with 1000 false ones. - humanity starts from scratch?

I love the idea of an archive of every solution to every problem existing but it's impossible to figure out the correct one. Infinite library like!

qlte 9 hours ago

keithnz 9 hours ago

SpicyLemonZest 10 hours ago

lalalanananana 11 hours ago

It's possible but the approaches these tools take are usually verbose and strange. Think about it like anything else llms do. Even when the picture is right and there are only 5 digits on each hand all the textures are off and so is the lighting and postures. Or in code, the code is always way larger then it needs to be and tightened up strangely with weird loose ends. Or in writing weird idioms, words, structure, and a weaselly way to turn 3 sentences into 8 paragraphs.

People usually use these tools in math and science to find an answer. Then often they will work it back using more sane or human pathways. So it's shareable or even beautiful.

Knowing the answer has value. But, often in math the best thing was how someone got there.

matherial 10 hours ago

Pure math is practiced mostly for the intellectual thrills and recognition among a very small group of peers. There's little else to it. You don't become rich, you don't become a celebrity. You teach students, write papers, and probably know most other people who work in the same subfield as you. Tao is a sort of a celebrity of the quarter on HN, but I promise you that outside this forum, almost no one has ever heard of him.

If you take that away and turn math into a less fulfilling pursuit where you mostly try to make sense of the output of an LLM, and it's "Astra's theorem #18398" and not "John Doe's last theorem", I'd wager that far fewer people will have any interest in the field.

This is really not unique to math, by the way. AI is undermining a lot of creative work. Why blog when you have much better odds of making it to the top of HN with autogenerated blog-slop? Why write books when many nonfiction categories on Amazon are now dominated by AI? The list goes on.

There's plenty of people on HN who think it's nothing new, ignoring the huge change in scale. And those who think this is good because there's no inherent value to human creativity if we can get the same content faster and for less. I disagree.

traes 8 hours ago

> Now, Tao is a sort of a celebrity of the quarter on HN, but I promise you that outside this forum, almost no one has ever heard of him.

This is an absurd thing to say. Hacker news is not the only place that knows about the most famous mathematician in the world. Glancing at Google Trends he seems to be roughly as famous as Linus Torvalds. Not exactly a household name but by no means obscure.

TrackerFF 23 minutes ago

matherial 8 hours ago

ReflectedImage 11 hours ago

Well no because it works by joining together existing novel insights.

roywiggins 10 hours ago

Today, maybe. Where's the law of nature that says it won't be generating novel insights in two years? Five? Ten?

colinhb 11 hours ago

Seems like in current cultural and economic context, short term extraction is what we’re going to do

> In short, the indiscriminate use of powerful solution-extraction tools can achieve the immediate short-term goal of solving problems at hand, but at the cost of sustaining the ecosystem for the next wave of progress, or in understanding the progress already obtained.

mizzao 7 hours ago

Is there an analogy here to the phenomenon that senior {engineers, designers, PMs} are now able to be insanely productive with AI, but it's also very hard to train junior folks to develop the sense of judgment that senior folks have?

CamperBob2 11 hours ago

The "ecosystem" is dead. Tao should be thinking about what will replace it. I don't understand why he's taking this tack.

david-gpu 9 hours ago

Aren't we in a similar position to what chess went through in the 2000s when Deep Fritz came out, and a desktop PC was able to defeat a reigning World Chess Champion? Did chess players just give up and stop playing? No, they didn't. They used these new chess engines to become better players. Computer programmers and mathematicians will probably go through something analogous.

Presumably it is only a matter of time until these frontier models are used to create new interesting conjectures. I don't get Tao's line of reasoning.

esteban0x 5 hours ago

Perhaps his takes are evidence of just usual human fear to new things. I see he relies quite much on the "community" or "social" aspects of the discussion.

I probably have delusional expectation of what a mathematician of his level should be talking about, but I expected from him a pure objective analysis on what to do with this new AI thing , what are its limitations, how it can improve the field and the creation of human knowledge, etc.

randomImmigrant 3 hours ago

In short, after after training AI on an extraordinarily amount of human cognitive output, we are now facing the possibility that our ability to train by working on hard problems will be slowly stripped away at least in some domains.

It’s like someone offers to build mag lev gym weights. It’s very cool that I can now lift the 500 pound weight with a finger. But what will I do when there’s no power and 500 pounds to lift?

Of course, cognition isn’t a single outcome problem like weight lifting. But we build cognition not wholly unlike how we build muscle: one needs resistance. Otherwise I’m not at all confident we “learn” in any depth.

gradus_ad 12 hours ago

>"While it may be technically infeasible to completely prohibit the use of automated tools to perform indiscriminate solution extraction, I believe that we can still designate many classes of problems as being desirous of a careful analysis that not only solves the problem, but identifies insights from the solution process, and learn more about the difficulty landscape for nearby problems, and for which raw solutions without such analysis would be of negligible or even negative value for these purposes."

Not sure I agree with this. AI generated proofs can still be analyzed and mined for useful insights. I suppose he's saying the process of banging our heads against the wall on a problem can itself yield useful insight? But what is stopping us from analyzing a proof after the fact. And if we can generate many different versions of a proof that should help us develop a much deeper understanding of the problem than we would have without being able to perceive the "proof landscape"...

btilly 8 hours ago

Perhaps reading https://www.math.toronto.edu/mccann/199/thurston.pdf will help.

The point of mathematics is not to prove results. It is to build conceptual thinking about mathematics. Important problems are important because in order to solve them we have to build concepts tying different things together.

We're not searching for answers. We're searching for insights. Trying to understand the problem causes us to draw the connections and find those insights.

AI gives us answers. But it doesn't help us build those insights. AI has a complete mastery of existing human insights. But doesn't build new ones from its own experience. In a real way, it does not find the opportunity to really learn.

So it tackles problems and either solves them or not. If solved, we now have an answer. If not, it's too hard for humans.

sobrey 11 hours ago

Not a mathematician.

The issue I see with a handed-over proof is tunnel-vision: you explore only the understanding of the proof.

Without a proof, your exploration branches out much further, in directions that could seem fruitless, but may uncover new understandings that are now "hidden" because the handed-over proof drastically lowered the incentives to find them.

cattenwallen 12 hours ago

I think you're misunderstanding the point of math problems. Mathematics is as much a process as it is a result. This is why even from early on, relatively rudimentary mathematics questions you are graded by your capacity to correctly achieve the desired process to the answer than getting the answer correct. The risk here is that AI generated proofs removes the process part of mathematics, where actually interesting concepts live (because then you can apply novel concepts to other unsolved problems and then thereby unlock new concepts that way...) Sure you can kind of try to reverse-engineer it but you lose the entire intuition and "we tried applying it in X, Y, Z ways and it didn't work" intuition, because even the non-working process can teach you about how not to apply the working process to novel problem spaces.

Basically: Tasting a delicious soup doesn't tell you how to layer the flavors, but if you want to be a good chef, you better be learning flavors more than you learn dishes!

ThrowawayR2 10 hours ago

- If you have only a fuzzy idea of how to get to your travel destination, wrong turns and alternate routes may reveal sights and places you'd never have encountered without that wandering.

- If your GPS directs you straight to your travel destination, you are now where you wanted to be but missed out on the exploration. This is the sort of consequences the AI math proofs have.

STEM research thrives on that side exploration and unearthing unexpected things along the way. James Burke's famous documentary Connections spends the middle episodes talking about the unexpected directions that exploration has taken science. It's very hard to credibly make the case that this sort of meandering exploration is not valuable.

SpicyLemonZest 12 hours ago

He's saying that in such a scenario, almost all of the value is located in the analysis and just dumping the proof has "negligible or even negative value". (The negative value would occur in the cases where the proof doesn't contain enough information to reconstruct what insights would have led a person to it.)

kragen 5 hours ago

It seems relevant that Terence Tao is the author of the paper that just about convinced everyone that the Navier-Stokes equations blow up in finite time, 12 years ago: http://arxiv.org/abs/1402.0290

silver92bullet 6 hours ago

I think this highlights one of the fundamental differences between humans and our current AI systems. They can still only try to solve problems in the given well defined parameters they are given (with some exceptions). The human is able in the effort to solve problems to intuit where there may be new interesting problems adjacent to the current problem.

akoboldfrying 6 hours ago

I don't think we can confidently say, yet, that LLMs can't discover those connections. We just haven't explored them yet, because 99.99% of the prestige is locked up in proving hard results, which also happen to be easier to assess objectively (thanks to automated proof checkers), and so that's where all the effort has thus far been exerted.

nullbio 5 hours ago

LLMs can discover anything. It is just a matter of creating the right goal function and teaching it the right heuristics. Right now, humans are required because humans know what humans want, and LLMs are not good at predicting what humans want to the point where they can safely and autonomously run off on their own to solve problems we didn't know we had, or to define the problems we have that we're not good at defining ourselves.

Once that is cracked, you throw more compute at it and practically every industry will collapse on a long enough horizon - with digital industries going first. Anything that requires physical hardware will require time for the machines to bootstrap, but that'll get there too.

Although, there are a few human-centric industries that will survive, for example: prostitution. Maintaining it's edge as the world's oldest and most enduring profession.

silver92bullet 3 hours ago

jujube3 10 hours ago

We're running out of math. Maybe the president needs to establish a Strategic Math Reserve.

meken 7 hours ago

I don’t see why it makes a meaningful difference if a human solves a math problem versus AI - it seems like the same amount of understanding will come out in the end. Either the understanding will come from humans arriving at the proof in the former case, or the understanding will come from humans understanding the proof that the AI came up with in the latter.

mrbungie 7 hours ago

Probably an AI-written Lean proof is very different to how a human would write it, and some may say it's more like mathy neuralese. For sure it works but it is not human-friendly and needs to be transformed into something more readable and digestible to be able to extract insights from it.

Not that different from when trying to read an out-of-control vibe coded codebases, or an sloppy AI long email that someone may send you at 9 AM.

meken 7 hours ago

Tao has a spiel in his recent interview with Dwarkesh where he says that AIs are very good at explaining things - so just have the AI explain the proof in a human-friendly way.

mrbungie 7 hours ago

porridgeraisin 6 hours ago

Because the problem has almost no value unto itself. The clay statement of navier stokes is not relevant to how CFD is done in practice.

It's about what is non verifiable versus verifiable. The same way it produces "slop" code (which, if you give it test cases, will be 100% correct), it also produces "slop" math.

Code that serves a business function, it's ok if its slop. Math that serves directly a business function also can be slop.

But most open problems are not directly for a particular usecase. People agree widely to attack it due to the perceived possibility of encountering useful mathematical objects along the way, that will then expand the world's mathematical toolset. This is not something that you can easily express in a verifier, and is thus something that is hard to force an LLM system to do.

You are right in that understanding it retrospectively is possible, but that is not going to be as useful as the desired "elegant" objects that expand and unify mathematics. You can't represent these concepts in verifiers.

Again, if you let AI rip at something like say "beat shannon capacity" and suppose it comes up with MIMO as paulraj did, great! It's useful and you can retrospectively understand it, say by expanding shannon to multiple dimensions, as foschini and telatar did. But most math problems are not in that category.

The question then is, if AI is really good at this type of math, how much of the existing mathematical community+process is necessary? I think it will still be necessary, just maybe in fewer cases. Wherever the primary purpose of the math is in a domain and that domain has a verifiable target, we can directly optimise it to that verifiable target in-domain rather than reach for the mathematical community. How well will this work? We'll see. It's not clear if it's even possible to represent most problems this way.

unified101 5 hours ago

> Code that serves a business function might as well be slop. Math that serves directly a business function also can be slop.

Both of these are simply incorrect - serving a business function means it's valuable to that function.

porridgeraisin 5 hours ago

olalonde 12 hours ago

Isn't it safe to say that all famous unsolved math problems will get a "massive amount of AI-powered effort" pointed at them regardless?

tzone 12 hours ago

While AI companies have almost infinite money, they still don’t want to blow million dollar budgets on problems if there isn’t high likelihood that it will be successful.

But within next 10 years as costs drop significantly and even more improvements are made, yes it is very likely that almost every single existing math problem will get a serious AI cracking done on it

curt15 8 hours ago

A "massive amount of AI-powered effort" costs a ton of money. What's the return on investment for these frontier labs? Do headline-grabbing successes in mathematics translate to expected *profitability* in disciplines with more immediately quantifiable economic value.

jdoliner 9 hours ago

My model of mathematical intelligence for a little while now has been 3 levels:

1. I give you a proof, you tell me if it's correct

2. I give you a theorem, you give me a correct proof

3. I give you nothing, you give me a theorem

1. is largely solved by modern LLMs and they took a big step toward 2. today with the Navier-Stokes proof. But they're definitely not there yet. It's unclear what progress is being made toward 3. for the time being that remains the realm of humans.

singularity2001 an hour ago

Strong disagree. They are of course infinitely renewable. Just work harder, Tao ;)

ppsreejith 8 hours ago

@Practal's comment is interesting:

> Pure mathematics is dead. Long live mathematics. I think all of interesting mathematics is applied mathematics in the end. Powerful AI means that the level at which we can do applied mathematics will be so much higher, though, and many more people will be able to be "mathematicians". The importance of pure mathematics is often argued for by citing examples of important applications that used pure mathematics invented a long time before the application became apparent. We can reverse this argument: by properly developing the mathematics our applications need, we surely will obtain all of interesting pure mathematics.

Perhaps the pace of applied mathematics would rise sharply, given cheap intelligence. And this* may end up being the forefront driving progress in mathematics.

*Or maybe a split between the human domain and the practical real world. Where the human domain might end up with a variation of a "No machine contributions" policy. Sorta like the recent gcc policy.

fwlr 8 hours ago

Open math problems, yes; also open source code, art, literature, and everything else as well. AI is a machine for turning commons into tragedies.

pvillano 8 hours ago

The way to tame a profit-maximizer is to make the most profitable choice the one that creates the most societal good.

I would like to see the Clay Institute give zero recognition for formalizations without human-readable proofs. That would incentivize OpenAI to scram or create something that's actually useful.

jfrbfbreudh 8 hours ago

It would be trivially easy to convert Lean into English, so I’m not sure what the human-readable criteria gets you. There are also human written proofs that are considered not human-readable by most of the mathematics community (ABC conjecture).

pvillano 5 hours ago

Human-readable means multiple humans can read and understand it in full. A human-readable proof is more worth more than one that is not, because mathematicians can read the proof and extract value in the form of reusable techniques, additional problems, progress towards related problems, and everything else Tao mentioned. A proof that only a few humans can read is more useful than one that no human can read because the few mathematicians that can read the proof can still extract value in the form of reusable techniques, additional problems, progress towards related problems, and everything else Tao mentioned. That's what the human-readable criteria gets you.

Mochizuki's claimed proof of the ABC conjecture is not unintelligable; it has errors. There are no proofs written by humans that are not human-readable, because in order to come out of a human mind, the proof must have fit there originally.

The four color theorem states that no more than four colors are required to color the regions of any map so that no two adjacent regions have the same color. It was the first theorem proved with substantial computer assistance. The theorem was proved by showing there could not be a counterexample. The authors made a list of maps where if a minimal counterexample existed, it would be one of these maps. There were 1,834 maps in that list, and each one was checked by computer. You could turn each of those cases into a picture or paragraph, but the resulting artefact would not meet my definition of human-readable.

Human-readable does not just mean in English. Humans can only hold a few objects in their short-term memory at once, not hundreds. Though some proofs require significant background knowlege, any proof written by a human will respect the fundemental limits of the human mind. There are no proofs written by humans that are not human-readable, because in order to come out of a human mind, the proof must have fit there originally.

I suspect large lean proofs generated by LLMs do not respect the fundemental limits of the human mind. If no human can read and understand them, no one can extract value in the form of reusable techniques, additional problems, progress towards related problems, and everything else Tao mentioned. If LLM proof generators can be made to write proofs with the same value as humans, that would be great! OpenAI would be a celebrated collaborator if they created as much value as a human does.

Jblx2 6 hours ago

OpenAI has already said they aren't going to claim the $1,000,000. If this proof claim holds up, then the Millennium prizes will be 2 for 2 for rejections of the prize money for valid solutions. Maybe that will be the precedent for other AI labs as well.

sno6 8 hours ago

"In a world where the cost of answers is dropping to zero, the value of the question becomes everything"

https://www.youtube.com/watch?v=dcolM6W5Odc

nadermx 9 hours ago

What is this man talking about. You can speak physics into existance now, yet it still has to be proven with math. Until we are walking through worm holes and driving around in spaceships that travel in a warp drive could he even begin to say there is non-renewable. But even then..

xelxebar 9 hours ago

There is also a large incentive for OpenAI to fold user conversations into the training process. Proving this happened is unduly hard, and given that professionals are using frontier LLMs for daily work, such training would make it easier for labs to scoop said professionals.

I have seen private correspondence between one mathematician working on Navier-Stokes and OpenAI that makes it sound like OpenAI deliberately scooped this Navier-Stokes result. The alleged correspondence also contained veiled threats if said mathematician went public.

qarl 10 hours ago

AIs are putting humans out of work.

Yes. We already knew this. Are we actually surprised it's happening?

I guess we are.

arjie 10 hours ago

Well, we name conjectures after the conjecturer not the (dis)prover so there is some incentive to be the guy who comes up with a hard problems. It is curious that we haven’t had something like this improve OR etc. problems. Perhaps not glorious enough.

p-e-w 10 hours ago

> Well, we name conjectures after the conjecturer not the (dis)prover

That’s not universally true. Some conjectures are renamed after being proven. For example, Fermat’s Last Theorem is now sometimes called the Fermat-Wiles Theorem, the Taniyama-Shimura Conjecture is often referred to as the Modularity Theorem now, etc.

program_whiz 11 hours ago

Timing is everything https://nonlineartransform.substack.com/p/ai-swarms-timing-i...

Article arguing math is the next "human calculator".

sxzygz 7 hours ago

Oh man am I totally going to determine the 10^10^10th digit of π and cement my name in the annals of history.

bibimsz 5 hours ago

it's 7

turtleyacht 13 hours ago

If proofs are tropes, explanations are stories. There won't be an end to stories.

vouaobrasil 11 hours ago

Actually there will because if you've actually ever spent time doing math, you only really get to that level of truly understanding and appreciating the stories if you've actually done the hard work yourself, which in turn will be economically infeasible due to AI. The analogy is interesting but incomplete and misleading.

gpm 10 hours ago

I've actually spent time doing math and literally everyone I know who knows math learnt it by reproving things that people proved before them. I don't see why AI proving things makes this form of learning any more economically infeasible than the field of mathematics already is - and since it was apparently economically feasible before AI I expect it to stay that way.

abdullahkhalids 8 hours ago

CamperBob2 10 hours ago

you only really get to that level of truly understanding and appreciating the stories if you've actually done the hard work yourself, which in turn will be economically infeasible due to AI

The thing is, nobody has time for that. Look at Mochizuki's work. It takes years of hard labor by high-level mathematicians to come up with stuff like that, and years of hard labor on the part of other mathematicians to validate it. The low-hanging fruit in math has all been picked, AI or no AI, and Tao doesn't seem to acknowledge that.

The mathematics community needs better tools or they're out of business anyway. Now they're getting those tools... and bickering and complaining about it?

vouaobrasil 10 hours ago

soundworlds 10 hours ago

I think this is where people will have to let go of the ego of being the "sole author" of a solution for us to move into the next era of human flourishing.

samwise99 9 hours ago

The future sole owners of half of San Francisco’s mansions thank you for your enlightened stance.

soundworlds 8 hours ago

The future I'm after involves Open models controlled by the people, not a few SC venture capitalists

LunicLynx 9 hours ago

Why not let AI proof or disproof this Tao - PI - Riemann zeta hypothesis

esafak 10 hours ago

It's the same pipeline problem coders have been talking about; once AI does all the work, how are people going to get the experience necessary to take part productively?

gpm 10 hours ago

See also his previous thread from before the result was published (and before he knew it was coming [1]) on how a to this problem seemed increasingly likely to be solved by AI in a way that caused us to miss the insights that would traditionally be associated with solving it: https://mathstodon.xyz/@tao/117207849921390904

[1] https://mathstodon.xyz/@tao/117219101339291693

gowld 10 hours ago

There seems to be a sense wher mathematicians are gamifying math, but are frustrated that AI labs are better at gamifying math.

If an AI solves a problem in an unenlightening way, then there's no reason for mathematicians to stop studying it. Pythagoream Theorem has hundreds of different proofs!

If an AI solves a problem in an enlightening way, mathematicians should study it and propose extensions.

kurtis_reed 5 hours ago

Tao seems to be stuck in a pure-math-for-the-benefit-of-pure-mathematicians mindset. The rest of us care about applications of math, not math itself.

kurtis_reed 8 hours ago

Plenty of new open problems will come from applications, and applications are what actually matters. Pure mathematicians are wrapped up in math for the sake of math which is a fun academic game but not something the rest of us should care about.

jijji 10 hours ago

The lack of reasoning traces in frontier model output is hurting science and progress... thats my take away from reading that, and why open source models are so critical and so needed, because they actually do expose the chain-of-thought reasoning traces recently missing from the frontier models (openAI, anthropic, etc). By encrypting and purposely hiding this important information from public inspection, it makes for a world where people lack the true understanding of how a problem gets solved.

ltbarcly3 12 hours ago

I think he's suffering from a sort of static-universe fallacy. People aren't going to keep doing what they are doing, but secretly.

What is going to happen is a complete revaluation of things like "finding a counter example to a famous problem". Even if someone finds a solution to a problem like this with pencil and paper, nobody will believe it, and they will assume that there was an AI involved.

Further, sitting and doing math with a pencil and paper will no longer be a reasonable strategy to build a reputation or career, beyond the benefit a mathematician gains to their own intuition and skill. People who work hard to build intuition and also use AI effectively will dominate the field.

In a world where everyone is using AI, the open problems that remain will be the ones that are AI resistant. This is no different that how things work now, mathematicians wait until they are fairly confident someone won't rapidly solve their problem before they start talking about it. They will do the same thing in the future, except in the future AI will be part of the toolset they use decide if they are ready to share yet or not.

Edit: Ok I believe I was generally right here, but I just read the details of what OpenAI did. They didn't solve a longstanding problem, they got tipped off to an approach a mathematician was using and would likely result in the solution very soon and they finished it first. If this turns out to be true I think my take above is not correct, in the short term people will have to stop sharing updates because otherwise openai will dishonestly race to finish their work.

dev_dan_2 12 hours ago

> If this turns out to be true I think my take above is not correct, in the short term people will have to stop sharing updates because otherwise openai will dishonestly race to finish their work.

Which I don't see a reason for Anthropic and "Open"AI not to, given their not so stellar track record with IP of individuals/entities-that-are-not-rich-enough ;)

senordevnyc 10 hours ago

People who work hard to build intuition and also use AI effectively will dominate the field.

This will be literally every field, sooner or later, at least until the human and their intuition is just slowing the AI down. There’s no scenario where humans without AI beat humans with AI in the long run, unless there are fields where the “alien intelligence” somehow hurts more than it helps (like artistic pursuits perhaps?)

coliveira 10 hours ago

This to me is another level of dishonesty. Imagine if a company producing math software starts to hear "rumors" someone is using their software to prove an important result and start massive runs of that software to beat the team. That may not be illegal per se but it is incredibly deceitful. I wonder if the original mathematicians should start a lawsuit for theft of intelectual property.

pizzly 10 hours ago

I would expect this for service providers that provide their "free" services but the mathematicians said they paid OpenAI to help generate this result. This is a clear conflict of interest. Similar to inside trading. Or the same lawyer being hired from two opposing sides which is a big no no. There are rules and laws that already deal with this in other industries and I expect that there will have to be regulation developed for cases where there is a conflict between AI customers and AI provider interest.

dakolli 10 hours ago

This is just the age of slop mathematics, if it doesnt lead to our lives neing improved none of this matters. Math peeps are being nerd sniped by AI in the same way SWEs (the worst ones) got sniped by claude code. Building solutions to problems that dont matter for the sake of doing it just because you can.

You'll ultimately waste a ton of time and get lapped by people doing real world work that actually improves the lives of regular people.

perching_aix 10 hours ago

alright, i'll bite: what real work did you put out there that has improved the lives of regular people in the past one year? (without the use of ai, needless to say)

johnsmith1840 11 hours ago

I mean, hasn't it always been this way? If something valuable is within reach and you disclose it, someone else might reach for it?

Just because the length of the arm is longer with an AI org doesn't mean it's somehow fundamentally a different system.

The future is that if you don't use AI your work is a lot easer to reach against someone else who has it.

That dude hand writing code with punchcards can be lapped by a 20yo with python, what's different?

calf 11 hours ago

The difference is no one writes punchcards so the comparison is inapt. It is more like supposing AI eats everything humans attempt to do. They will take your work as you are working on it, any interaction at all. It is meta-plagiarism, on another level.

johnsmith1840 11 hours ago

AI didn't "take" anything. An openai researcher did?

The solution is also different to theirs? Literally no evidence of plagarism?

opello 10 hours ago

woodgala 11 hours ago

It sounds like a fancy way of saying kids will forget how to do math if they use calculators. The flattening of the space makes it hard to find new problems deemed significant? Maybe that went over my head, I’ll concede that point.

fwip 11 hours ago

What? No, it's nothing like that. It means that if you have a critical insight and you share it out loud, somebody with no particular mathematical inclination can just spend lots of money to steal the credit from you.

It shifts power further from the worker toward those with capital.

grog454 10 hours ago

> We have now seen that even the rumor of someone working on a problem can trigger a massive amount of AI-powered effort to flatten it before the original research project has time to reach its full potential.

In other words, the "right" people need to solve it: the mathematicians who made it their job and not the people working to push AI models forward?

Struggling to understand how a solution to a millennium problem like this isn't a net positive. Presumably Open AI employs mathematicians in these efforts anyway. And I can think of far worse uses of the AI compute resources.

xmprt 10 hours ago

If there are no incentives for mathematicians to work on and share progress in tough problems because they will get scooped, then they will end up quitting and in net we will see less progress overall.

greenowl 9 hours ago

Mathematicians can join the club like the rest of us.

Time to consider re-training to become a nurse, electrician, auto mechanic, or a plumber.

magicalist 9 hours ago

> In other words, the "right" people need to solve it: the mathematicians who made it their job and not the people working to push AI models forward?

This is not at all what he said? I'm not sure how you got this from anything he wrote, actually.