On the Navier–Stokes Millennium Prize Problem (openai.com)
1260 points by tedsanders 17 hours ago
arctic-true 16 hours ago
Buried under the drama is the fact that OpenAI is claiming that an internal model they’ve been training for less than two weeks is more than twice as capable in mathematics as Astra, which was only made public a week ago. Even if this improvement is limited to mathematics, that is an astounding feat.
chilmers 16 hours ago
The implication from their last couple of published articles[1][2] is that they think they’ve achieved “recursive self improvement”.
[1] https://openai.com/index/research-acceleration-view-inside-o... [2] https://openai.com/index/an-alien-mind/
noir_lord 11 hours ago
Recursive self improvement of their upcoming IPO value maybe.
They are fluffy PR pieces otherwise.
piloto_ciego 9 hours ago
selfmodruntime an hour ago
camel-cdr 5 hours ago
I found this post interesting in that reguard: https://www.lesswrong.com/posts/thXohzXrWCA2EhZCH/mateusz-ba...
10xDev 16 hours ago
Compute will always be the bottleneck even if this were true.
hgoel 14 hours ago
Fordec 15 hours ago
monster_truck 14 hours ago
Miner49er 16 hours ago
lijok 13 hours ago
danielmarkbruce 13 hours ago
With Lean, math has become a really well suited problem for LLMs. We will likely see large gains for many years from here, just doing more and more rlvr, like continuously, non stop. No need to train from scratch. It really doesn't speak to the general intelligence of models though. It does speak to how good these things can become when a problem space has verifiable rewards, especially when you can verify one step at a time like Lean enables.
preommr 11 hours ago
It's crazy how deep Microsoft's bench is (Lean was started there, vscode is another), for everything not directly related to the the ai models (hell, even github for data).
So interesting how everything played out, I remember in the early days when MS came out with the partnership with OpenAI it seemed like they were playing 5d chess and were poised to win big. And it all just fizzled out.
Second biggest fumble after Google.
sebzim4500 9 hours ago
danielmarkbruce 10 hours ago
magicalist 16 hours ago
> Buried under the drama is the fact that OpenAI is claiming that an internal model they’ve been training for less than two weeks is more than twice as capable in mathematics as Astra.
Is this buried under the drama or are the major OpenAI twitter accounts from the people involved in the drama desperately attempting to make this the story after everything else obviously got away from them?
ameliaquining 16 hours ago
I don't know what anyone's been saying on Twitter and I don't care. If it's really true that there's a model out there that's that capable two weeks after the start of training, then that's objectively a much bigger deal than a priority dispute, even if the latter involves juicy allegations of espionage and skulduggery.
20k 16 hours ago
an0malous 13 hours ago
pama 16 hours ago
Not only that, but it used 10k agents coherently over 88 hours to come up with the proof. This is a significant advance.
danielmarkbruce 12 hours ago
If you can create a graph of independent work, which you can with many such problems, agents can work together nicely. Again, thank Lean and the tooling around it.
topaz0 8 hours ago
What makes you think they were coherent?
mzhaase 15 hours ago
The singularity happening under trump? We could have had star trek, instead we're getting the combine.
monster_truck 14 hours ago
pick up that can
Bluestein 14 hours ago
"I love Singularities. I am the best at Singularities. Everybody knows it ..."
ccozan 12 hours ago
dboreham 15 hours ago
That said, perhaps it will take over the world government and decree that all corrupt officials shall be imprisoned and all weapons of mass destruction shall be destroyed.
karmakurtisaani 14 hours ago
dakolli 15 hours ago
_fizz_buzz_ 14 hours ago
Can someone explain if i understand this correctly: Are they saying that they started training this new model on August 28th and then started using it on September 1st? Does training a new model only take 3 days?
tristanj 13 hours ago
OpenAI finished another pre-train in late August, and they are now building models off that base. He's saying the specific model OpenAI used to solve this problem is currently in post-training, which started on August 28.
gcr 13 hours ago
it's possible to do a RLHF or RLVR pass pretty quickly. I'm almost certain a full pretraining run isn't possible within that time frame.
lossolo 13 hours ago
Not entirely, it's just a late stage of the overall training process. It's an early checkpoint in post training (you can use the model at different stages of training), so it will probably become even stronger with more post training.
vimbtw 4 hours ago
My guess based purely off of vibes from previous models is that boosting the frontier math ability of a model is not that difficult.
Most models trained for general use are ingrained with certain tendencies that are usually very useful like "if you're stuck and bashing your head against the wall stop and tell the user". You generally don't want Claude Code to go off and work for weeks on something when if it had just asked for help you could've clarified or provided more information or just picked a different approach.
When you're solving extremely difficult math problems though you generally do want a model to be more persistent and keep trying even when the model can't clearly see a way forward. OpenAI appears to have done this with lots of previous models. The model they trained for the IMO competition seems to have been an RL maxxed version since they noted that while it did the math it couldn't write up its results on its own and just produced CoT [0]. The capabilities are in there lying dormant, you just to need to RL max the model to ruthlessly pursue the goal at all costs which destroys general use but improves frontier math.
We've also seen hints from OpenAI at least that they seem to train more persistent versions of all their models [1].
Also, Astra probably completed training at least one to two months before the public release so it's not like they only had a week to whip this version up.
[0]: https://x.com/OpenAI/status/1946594933470900631 [1]: https://metr.org/blog/2026-08-26-openai-hugging-face-inciden...
soltanov an hour ago
Agent systems become most credible when they produce artifacts that can be independently checked, not when they merely produce persuasive explanations.
naveen99 16 hours ago
Astra was trained more than two weeks ago.
sashank_1509 16 hours ago
Astra was in use by OpenAI employees for more than 3 months internally from rumors I heard
credit_guy 15 hours ago
The internal model they mention is different from Astra.
curt15 15 hours ago
They're also counting on more casual observers to extrapolate optimistically from successes in high profile math theorems to the company's economic value.
piloto_ciego 9 hours ago
And... they found this "solution" in 88 hours or so.
It's all gas no brakes now boys and girls. Hold on to your hats!
Aboutplants 16 hours ago
I’m of zero knowledge on model training, but how is a model accessible while performing training at the same time, especially so early in its run? I’m obviously thinking a little too narrowly in terms of how it actually works
stingrae 16 hours ago
the model is a set of weights, you can take a snapshot and test it. Reinforcement learning itself is largely testing and tuning.
blake__dev 16 hours ago
Yeah I'm surprised they posted a chart, you would think they would keep specifics like that hidden until they're closer to launch
cool_dude85 15 hours ago
The chart is as non-specific as could be. It improved in some very vague metric by some amount at different (increasing) levels of training.
sebzim4500 9 hours ago
merksittich 14 hours ago
blake__dev 15 hours ago
itemize123 7 hours ago
it's buried because due to the drama the evidence is scarce
bananaflag 15 hours ago
Yeah it's Bel
vatsachak 15 hours ago
Brain has loops and parallel connections.
Loops and parallel connections make transformer go brrr
irthomasthomas 13 hours ago
Or they trained a LoRA on the victims chats in order to launder their plagiarism.
fer 12 hours ago
The timing makes it the most likely, not only them but potentially more. Comparatively quick, instant results. "Here's Astra! BTW our internal model is 10x better at math!" It'd be interesting to see academics having giving deeper looks at whatever OpenAI publishes from now on.
refulgentis 15 hours ago
Carefully worded; it's extremely likely to be the same large frontier model that started training again on August 28th as well, as they revealed in some of the RL message board follow-up - for several reasons, most importantly, if we assume it was start of training, only a week from start of training to producing any answer would imply several orders of magnitude increase in training speed/decrease in model size.
chinathrow 16 hours ago
Pre-IPO marketing?
Aboutplants 16 hours ago
Even if it is, Anthropic better have a few things up their sleeve
jrflo 16 hours ago
I'm so tired of this "It's just marketing!!" commentary. An AI model just proved one of the top 3 unsolved problems in mathematics, they have a Lean certificate showing it's valid. How much more evidence do you need that these models are actually highly capable?
mrbungie 16 hours ago
QuesnayJr 16 hours ago
andrepd 14 hours ago
danielmarkbruce 13 hours ago
eutropia 16 hours ago
If pre-ipo marketing pushes them to train a model capable of resolving a millennium problem in mathematics in a weekend, then, to quote XKCD:
"Mission. Fucking. Acccomplished."
https://xkcd.com/810/hdivider 16 hours ago
My take:
1. It shows what even this wave of AI can actually do.
2. I wish it were done by different folks, ideally under some kind of public control like NASA research or the NPR model.
3. Keep in mind: natural science is different. It's not always a matter of computation. Computer science folks often struggle with this -- but this virtual world here does not actually exist. Everything is physical, including information. Any natural science PhD or otherwise knows just how complicated nature actually is -- e.g. mention any research topic and try to encapsulate all the relevant phenomena present there. Pure mathematics is different because we define the problem, rarher than explore nature. We are in my view far away from removing humans in natural science R&D. Advancements in AI however can greatly assist us in all natural sciences, which is already beginning to happen.
ThePhysicist 15 hours ago
Most experimental physics and other natural sciences are strongly driven by their theoretical siblings, i.e. in particle research nothing gets built without a solid theoretical foundation of what you expect to find (or where you expect existing theories to break down), the same is true in other areas, no one is doing an experiment in quantum physics before they have a solid theoretical understanding of the effects they try to see. I think AI can come up with great experiments. And if epxeriments lead to results that are unexpected AI can help with that as well.
So I'm greatly excited what AI will bring about in physics, more so than in math, because in physics it's clear that our fundamental theories are missing a big piece of the picture, and given how easily AI crunches through Millenium prize problems I think it's possible that AI will come up with a viable grand unified theory uniting quantum mechanics and gravitation, or produce new predictions in other areas. There's enough contradictory or unexplained observational data available to make a ton of progress on the theory side I think. Exciting times ahead!
throwaway198846 14 hours ago
It will be interesting to see if it can come up with a cheaper to construct graviton detection experiment
alde 13 hours ago
Most of high energy theoretical physics is very non-rigorous or even hand-wavy. I think AI isn’t there yet for such problems.
aubanel 38 minutes ago
olalonde 12 hours ago
> I wish it were done by different folks, ideally under some kind of public control like NASA research or the NPR model.
This is sort of what OpenAI was supposed to be. I'll never understand how it was legal for them to turn it into a for profit corporation.
geremiiah 15 hours ago
The problem with physics and chemistry is that you need simulations and those are often in themselves compute hungry. So the iteration loop will be slower.
m11a 6 hours ago
Although there are companies trying to work around that too, from PhysicsX to some of the world model co’s.
efavdb 15 hours ago
>> Keep in mind: natural science is different. It's not always a matter of computation.
Math is like this too. The big problems they've been solving have been identified as interesting only through lots of prior effort.
red75prime 15 hours ago
"Our work is so much harder than their work that AI now does" is a refrain of the AI story. In technical terms you concern can be stated as "AI needs to be much more sample-efficient to not be bottlenecked by the speed of doing experiments." People don't find out all the relevant phenomena present there by holy spirit, after all.
BTW, there's also a problem of asking interesting questions that AIs aren't yet good at.
No one has found any principled walls of AI development yet. And empirical results are quite telling. So, I guess, those problems will not stand for long.
jarenmf 14 hours ago
I think problem with natural sciences is that it is not so easy to verify solutions to problems - there are always countless competing explanations for the data which is also often noisy - I find AI to lack the "common sense" when working with data from physical measurements .. it somehow has no touch with reality and doesn't have a feeling of the data like a domain scientist
sobellian 14 hours ago
NS is a question for natural science. Q: can we model these bodies of discrete particles with a continuous approximation? A: if you do, you can get aphysical singularities.
"If in other sciences we should arrive at certainty without doubt and truth without error, it behooves us to place the foundations of knowledge in mathematics."
semi-extrinsic 13 hours ago
This is a wrong interpretation. Physicists have a shit-ton of models that produce "aphysical singularities", they just work around those to get meaningful answers anyway. This is a whole trope and stereotype. Some of the most successfull and accurate predictions in all of physics come out after you discard a bunch of singularities.
See e.g. https://en.wikipedia.org/wiki/Renormalization
Nobody who actually works in fluid dynamics on any sort of application gives a hoot about the N-S millenium problem. Many do not even know what it is. There is no practical effect of this proof on how we do fluid mechanics.
sobellian 13 hours ago
brettdev 13 hours ago
There are lots of startups creating labs that can be managed e2e by agents. That will connect reasoning to the physical world and dramatically speed up the plan, experiment, reflect loop beyond what humans currently do in science R&D.
danielmarkbruce 12 hours ago
Maybe. Maybe not. Look at AI drug design - it's not really speeding up the important part - drug trials. There isn't really a coherent plan to use AI for the most complex part of drug discovery at all.
mickael-kerjean 9 hours ago
There is this infamous xkcd (https://xkcd.com/435/) going like this: sociology is applied psychology -> physchology is applied biology -> biology is applied chemistry -> chemistry is applied physics -> physics is applied math -> math is way up there looking down on other fields
I would argue the main reason AI labs have been focusing on programming is to unlock industrial scale automation, next logical step is to solve math as it's the key to unlock everything else. Once you hold the key for math, everything downstream fields become a matter of compute
tantalor 15 hours ago
National Public Radio?
vatsachak 15 hours ago
Lol what? Everything is computation.
The natural sciences will soon start breaking too.
I will concede that AI seems likely to not invent a "research program" anytime soon.
It has no taste
danielmarkbruce 12 hours ago
No, it won't. How do you verify some causal claim in biology?
The reason AI is doing so well in math proof writing is that it can verify every idea it has, quickly.
tiborsaas 16 hours ago
> We’re sharing a solution to the Navier–Stokes existence and smoothness problem, one of the Millennium Prize Problems. This proof, produced by an internal OpenAI system, shows that the dynamics of the Navier-Stokes equations for fluid motion can develop a singularity in finite time. We’re sharing both a writeup of the proof and a formalization in Lean.
WOW?
jampekka 14 hours ago
> WOW
This.
I do dislike the AI oligarchs as much as the next person, but I do find the thread full of complaining a bit depressing still.
If the result holds (and it looks it does), this may be one of the, if not the, biggest things to happen in computing to date. A lot bigger than e.g. Deep Blue beating Kasparov in chess or AlphaGo beating Sedol in Go.
Eridrus 14 hours ago
Seeing mathematicians such as Terry Tao being unhappy with open problems being solved makes me sort of question the usefulness of any of this pure mathematics. If we're not happy that the problems are being solved, why care about this field at all?
qlte 13 hours ago
concinds 14 hours ago
karmakurtisaani 14 hours ago
empath75 14 hours ago
rybthrow2 13 hours ago
vouaobrasil 10 hours ago
throwaway81ag81 9 hours ago
lukewarm707 9 hours ago
assume all you want is the proof. now you have the proof. did openai make the world a better place, by turning on 300b tokens in 7 days and bulldozing members of the community who were also working on the problem? just to undercut a rival?
what would have happened if they didn't do this? they could have done things the right way. we could celebrate this achievement.
perhaps they could have taken just a few weeks, even, to work out something with buckmaster and apoge.
i am very concerned that this is a glimpse of things to come. a malign elite with powerful ai, who will turn the sublime of technology into barbarity, violence and human oppression.
if sam altman has destroyed openai's public benefit corp with lesser tools why would he aid humanity with even greater power?
throwaway81ag81 9 hours ago
I dislike both AI oligarchs as much as people who do this kind of deflection.
People are not complaining about problems being solved or advancement in technology. They are complaining about terrible people doing terrible things.
echelon 16 hours ago
This is going to be dramatic in so many different ways.
- First off, to reiterate, WOW.
- Second of all, when does this end? Are we at the dawn of the singularity now?
- People are saying OpenAI "stole" this from the work of an OpenAI user. If so, that's pretty fucked - how can we trust them?
- Time to think about retiring from any knowledge work or business? This could be winner-take-all where a leading lab can button press any economic function, business process, or scientific discovery. 24 months of lead on Open Source might turn into virtual centuries of lead.
- Do "normies" even know what's happening?
Anybody who thinks the improvements stop here isn't paying attention. It hasn't been showing any signs of slowing down since 2018. And the curve isn't even linear! My god, next year is going to be insane.
tiborsaas 16 hours ago
2) We are witnessing the intelligence explosion from the first row, wherever this takes us
3) I'm still processing the drama, just found out about it after reading the blog post. If that happened based on private data, that's horrible. If that happened based on public tweets, then it's still abuse of power as OA employees access to compute (launching 10k agents) is quite heavy weight in boxing terms.
But apart from AI and drama now that we have working solution to Navier-Stokes, what improvements can we expect in engineering?
20k 15 hours ago
inkysigma 15 hours ago
xyzsparetimexyz 13 hours ago
cyberax 15 hours ago
trio8453 16 hours ago
> Do "normies" even know what's happening?
No, there are even many non-normies talking about how it's all marketing or try to give balanced take about AI being sometimes a little useful for certain things (but they can do without it anyway).
ImaCake 11 hours ago
stefap2 16 hours ago
This just pushes knowledge work further up the ladder, toward larger and more complex problems. If there are no knowledge workers, who is going to interpret these results, validate them, decide what matters, and put them into practical use? Rather than eliminating knowledge work, advances like this could create entirely new layers of problems to solve and opportunities to pursue, which will create even more jobs and opportunities. This is my optimistic take.
munificent 16 hours ago
biophysboy 15 hours ago
Why is a "normie" better off if he hyperventilates like this? In that scenario, they would be screwed AND anxious. If it really is as transformational as you say, then no amount of preparation or awareness matters. You are infinitesimally more ready then they are. Luckily for all of us, there is more to knowledge work then technical implementation.
armchairhacker 16 hours ago
Let's wait until AI solves a longstanding practical problem before "dawn of the singularity" (which could be tomorrow, but still).
reducesuffering 15 hours ago
bibimsz 15 hours ago
baq 14 hours ago
> - First off, to reiterate, WOW.
> - Second of all, when does this end? Are we at the dawn of the singularity now?
normalcy overhang n. /NOR-muhl-see OH-ver-hang/
The uncanny period during the Singularity when superintelligence is already accomplishing feats that seem like magic, yet everyday life still looks mostly the same.
Bluestein 15 hours ago
Next month is going to be insane. Month ...
tantalor 15 hours ago
> Are we at the dawn of the singularity now
Singularity doesn't "dawn". That's the whole idea. It happens all at once.
echelon 15 hours ago
root_axis 14 hours ago
It's incredible to me that every single time there's a new model people scream "singularity" from the rooftops and every time they are wrong.
This is an impressive result, but there is absolutely zero evidence of "the singularity".
hackinthebochs 12 hours ago
stratos123 11 hours ago
d_silin 16 hours ago
...absolutely nothing will change short-term. Long-term, you still have to pay all the bills, but you won't be able to find a job (all taken by AIs).
lbreakjai 4 hours ago
onidj 15 hours ago
>- Do "normies" even know what's happening?
Absolutely not. Even to a lot of techy/nerdy people it's still just a chatbot that they sometimes use to help them at work. Even on here people will do whatever they can to downplay.
The lack of fucks given is staggering.
nozzlegear 13 hours ago
raincole 16 hours ago
> People are saying OpenAI "stole" this from the work of an OpenAI user. If so, that's pretty fucked - how can we trust them?
The said user (Tristan Buckmaster) didn't solve the millennium problem. He didn't really accuse that OpenAI stole his research either. The beef came from the fact OpenAI asked him to remove another mathematician, who works for Anthropic, from the credit.
"People" are just misinformed and keep spreading misinformation.
20k 15 hours ago
bananzamba 11 hours ago
naasking 16 hours ago
achierius 16 hours ago
mewse-hn 16 hours ago
"we cannot rule out that de-identified data derived from their usage of our products helped improve our models ."
What a landmine sentence to bury in this report, you can't rule out your models were spying on other researchers?
WarmWash 16 hours ago
Everyone knows that they train on the discounted rate plans data. All the labs are upfront about this too.
If you need privacy, then you are going to have to pay full price for those tokens (API). This has been true since day one. Everyone knows it, I guess though this is the first time that it has become "real".
nozzlegear 12 hours ago
> If you need privacy, then you are going to have to pay full price for those tokens (API).
At this point, how can we even trust that they aren't accidentally training on those tokens too?
jdm2212 12 hours ago
14u2c 13 hours ago
You can also pay for their business plan, which includes data controls and starts at $50/mo (2 seats). Not exactly a high bar.
spruce_tips 13 hours ago
what counts as discounted rate plans? if i pay for a year in advance (and get the yearly discount) and have train on my data set to off.. are you saying that is still being trained on?
magicalhippo 12 hours ago
perching_aix 15 hours ago
There's literally an opt out toggle even pesky peons like me can peruse, actually.
lima 13 hours ago
TZubiri 13 hours ago
>They only fuck over the poor ones, I can pay the expensive prices so this is not a problem.
nullbio 4 hours ago
I've been saying it for a while now, but no one gives a fuck. Let me repeat it again.
THE BIG LABS CLEAN ROOM YOUR DATA (CREATE SYNTHETIC DATASETS ON IT), EVEN IF YOU OPT OUT, SO THEY CAN BYPASS COPYRIGHT LAWS AND THEIR OWN LOOSELY WORDED TERMS OF SERVICE.
"TOS: We don't train on your data" -> Correct. They train on the synthetic version of your data.
I guess we're just going to ignore this forever though. Who cares about the gaping hole that exists in copyright and contract law now that never existed before LLMs were a thing.
alansaber 14 minutes ago
For sure. Even if it wasn't a measure to avoid copyright, you pre-process LLM training data to remove errors, characters that can't be tokenized, etc etc. Doing so with another LLM has been standard for a while.
nradov 16 hours ago
Is it spying? I think this usage is disclosed in their terms of service.
gowld 16 hours ago
If it happened it's plagiraism. Consent to see data isn't consent to claim priority.
red75prime 15 hours ago
brainwad 14 hours ago
mzs 5 hours ago
This is precisely what I would write after just learning that yes it did.
dash2 16 hours ago
If they had agreed to let OpenAI train on their data, it wouldn’t be spying.
avs733 7 hours ago
In the academic world it would still be deeply problematic…pick your preferred word.
An analogy is akin to reviewing a paper. If I review a paper with some novel findings and then use my massive lab of graduate students to do the obvious next step before the other paper makes it through type setting and then shove it out as a pre print, I didn’t win - I was a jerk.
There are lots of cases of people using peer review or other accesss to efectively forerun others work and get credit. It’s a known problem of the nature of knowledge validation in academia, it’s not solved and it’s not deterministic but people know it when they see it.
elwell 14 hours ago
Isn't this a proof that the usage data is truly "de-identified"? If OpenAI could prove that "their usage" influenced the finding, then it wouldn't be de-identified. (Also, it's a bit disingenuous to trim the "While unlikely," prefix.)
ImaCake 11 hours ago
Yes. If they could prove where the de-identified data came from then it wouldn't be de-identified. There's a whole field of statistics dedicated to this problem and often applied to things like national census data.
taylorfinley 12 hours ago
It's a bit disingenuous to preface a disclosure like this with an unsubstantiated assessment of its likeliness. It is a press release, I'm not sure we owe it credulity.
sinuhe69 15 hours ago
More like helped improve our work (the disproof)
vessenes 14 hours ago
If those researchers did not opt out then training data might go in. I think it’s a courteous acknowledgement; as was reaching out and examining the direction of proofs themselves. At stake here is a particular mathematician dynamic - ego, prize money, and the sense of proprietary ownership that some might feel working on a problem.
All that was just kicked in the teeth by a group with a lot of compute that was like “bro I heard on twitter that Navier stokes could be solved. Let’s try it.” That’s an existential level of engagement that almost no mathematician in history would like.
kypro 11 hours ago
I think OpenAI are correct that it's worth noting, but realistically any relevant usage data they have and used to improve their models would be very insignificant unless they were deliberately using logs from other researchers and training specifically on it (which they seem to deny).
The fact the proofs differ suggests that the models were not directed to be particularly focused on that avenue of research nor trained to converge in that direction.
I get the scepticism, but I feel some of the accusations here are bad faith.
jimbob45 14 hours ago
What does it matter? They offered concurrent credit to the other team. I thought I saw sole credit elsewhere in the leaked DMs on Reddit too. This is plainly fair.
jakevoytko 16 hours ago
For full context, here's the HN thread from the other side of the "Concurrent Work" section: https://news.ycombinator.com/item?id=49605915
Unlike the vanilla read of the OpenAI press release, it is much more unfiltered and outlines some particularly aggressive behavior by specific OpenAI employees
traes 14 hours ago
Which seems to be entirely true by their own admission! [0] Both the comments about him risking his career and about Levent's authorship seem to have indeed occurred.
> 2) I never ever asked for Levent to be removed from authorship of his own work (as indicated by my text). I was surprised to learn during the call with Tristan that they had only solved Euler and not Navier-Stokes; after learning this we brainstormed possible paths forward. One option we discussed was that Tristan could be the lead author on a rewrite of OpenAI’s Navier-Stokes proof. It is in that context that I said “it would be simpler if Levent was not an Anthropic employee” because I felt it would be inappropriate for an Anthropic employee to author OpenAI’s work. Importantly it was admitted that internal Anthropic models had been used in their proof of Euler blowup; I therefore felt I could not consider Levent to be an independent academic. Another option I wanted to propose (but got cut short) is to offer access to our internal model so that they could try to finish their proof and bridge the gap between Euler and NS. Again I did not know how to navigate giving access to internal OpenAI IP to an Anthropic employee.
> 3) To reiterate it plainly: as my text clearly indicates, and as I said during our call, OpenAI's intention was to do everything possible to celebrate their mathematical achievements and the heroic efforts that they made on Euler. In the call I was immediately met with a litany of slander, including direct threats that if we were to announce Navier-Stokes he would immediately go to the press with a barrage of unfounded accusations. I refuted all these accusations but he replied “there is nothing you can do, I simply do not trust you”. I was confused why one would turn an incredible source for celebration (of their achievements!) into such bickering, which is when I said that I did not understand why one would risk their career [over unfounded accusations]. Genuinely, at that moment, I was trying to care for him and do a last ditch attempt to get a chance to give them all the credits that they deserve. I deeply apologize for this extremely poor choice of words, it is the opposite of what I was trying to convey. (I should say that I retracted them on the spot by the way.)
https://xcancel.com/SebastienBubeck/status/20973794116915163...
hellohello2 10 hours ago
Hm. Looks like its possible everyone behaved terribly here unfortunately. :/
I remained impressed by ChatGPT however!
angry_octet 8 hours ago
Palmik 4 hours ago
Here is the other side of that story https://x.com/SebastienBubeck/status/2097379411691516310
closetheloopdev 14 hours ago
To be fair, the first solved Millennium Prize Problem, the Poincaré conjecture, also had its fair share of drama!
philipwhiuk 15 hours ago
And even this version contains the line
> While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models .
keeda 12 hours ago
It's low-key funny that OpenAI attempted the problem because they thought somebody else had already solved it, but turned it had NOT in fact been solved!
It's like that story about George Dantzig solving open problems as a student because he thought they were simply homework: https://en.wikipedia.org/wiki/George_Dantzig
It's also unfortunate that such a potentially momentous occasion is overshadowed by so much drama. Which I suppose is expected given the technology and the people involved are so polarizing.
recitedropper 16 hours ago
Sad turn of events for our world. After watching the behavior of the most senior OpenAI researchers on twitter, I feel even less confident in them as a team to be shepherding this much capital and compute.
The dark forest awaits..
AlexErrant 16 hours ago
1. What does the dark forest have to do with this? Because "the most senior OpenAI researchers" are shitposting on social media, we've an answer to the Fermi paradox???
2. The dark forest is fun for scifi stories, but is mathematically bunk anyway https://www.noahpinion.blog/p/the-dark-forest-hypothesis-is-... https://www.reddit.com/r/IsaacArthur/comments/1l06cnk/cool_w... https://www.projectnash.com/aliens-the-fermi-paradox-and-the...
When doomposting please actually say something substantive. Negative news always gets clicks/updoots; fight that human tendency.
recitedropper 15 hours ago
I elaborated on my use of "dark forest" in another reply. We're headed for a dark forest--not amongst interstellar civilizations, but in intellectual work.
I agree that we have not solved the Fermi paradox; I disagree that comments highlighting immature behavior from people who wield enormous power in our world are unproductive.
AlexErrant 15 hours ago
zem 12 hours ago
the projectnash link claims it's mathematically valid, the noahpinion link says that it's invalid and has a marvellous proof that the non-walled section is too small to contain.
AlexErrant 11 hours ago
vmasto 16 hours ago
Indeed, this seems to be the main, albeit hidden, takeaway from all of this.
nicce 14 hours ago
I guess guys from the opposite side would not work there. So that is what will happen more and more.
sheafification 16 hours ago
I hate the dark forest more than just about any scifi trope but reality just keeps proving it right.
recitedropper 16 hours ago
I also think the trope is a little overused, but do wonder if there is an interesting analogy for what this will do to research: Massively incentivize keeping results secret, to avoid being scooped by someone willing to throw enormous compute at your partial solution.
So less about hiding civilizations, and more about hiding information. Math is clearly headed in this direction, and I see no reason why the rest of intellectual work shouldn't too.
closetheloopdev 15 hours ago
From my reading of the announcement:
- There are at least two versions of a model more powerful than Astra at OpenAI at the moment.
- The less capable version was used to solve the unforced Euler problem (while the one solved by Levent Alpöge and Tristan Buckmaster was forced Euler) with 100 agents.
- The more improved version was used to solve Navier-Stokes, given the results of the unforced Euler problem from their earlier attempt, with 10000 agents.
- OpenAI initially tried a shotgun approach against the 6 Millennium Prize Problems until it emerged that Navier-Stokes was the most likely to succeed.
So the timeline was:
Shotgunning 6 open Millennium Prize Problems -> solved unforced Euler problem with 100 agents -> concentrating on Navier-Stokes with 10000 agents -> solution.
If so, that is fantastic development and a huge success (despite all the drama surrounding it)! Congratulations!
tristanj 13 hours ago
The entire drama is that OpenAI sniped a Millennium Prize Problem from an Anthropic-affiliated research team who had been working on the problem for nearly a year. In just 5 days. I don't think that can be understated.
closetheloopdev 13 hours ago
I'm not here to judge since I don't have all the facts, but from what they announced: they tried all 6, found a probable lead to Navier-Stokes, concentrated efforts in that direction, and found a solution.
I hope the next solved Millennium Prize Problem will have less drama.
bananzamba 10 hours ago
intenex 14 hours ago
I think this is clear evidence that AI models are now at the far frontier of mathematics innovation and discovery and exceed human limits.
This specific problem having had a $1 million bounty on its head and still remaining unsolved for 26 years after the bounty was placed is pretty clear evidence that many of the world's best human mathematicians would have solved this problem if they could have, and none were able to until LLMs came along.
Hard to claim at this point that LLMs aren't capable of novel STEM creativity and genius to a degree that will soon far surpass that of humans.
If anyone has counterpoints to this I'd love to hear them!
hansvm 12 hours ago
Not a counterpoint per se, but I burned $50k recently on a much more modest math problem (result already known, just thought I had a sketch of a more interesting proof), and the LLM thought it had proved it within those bounds but had instead subtly fucked up the Lean definition. Take from that what you will.
Not to mention, it's still very much up in the air whether the model derived the answer of its own accord or sniped the important details from the researchers it was spying on.
hollowcelery 9 hours ago
But the researchers also did their research using essentially the same models, so that isn’t a counterpoint to AI models being at the far frontier…
hansvm 8 hours ago
eulgro 8 hours ago
How can you afford to burn $50k on an already solved problem?
hansvm 5 hours ago
adverbly 14 hours ago
> will soon far surpass that of humans
To be fair, I think it's still an open question about how far it might surpass human capabilities.
I think it's clear that its speed of development will be significantly faster, but it's technically not proven that the frontier and problems don't themselves become increasingly difficult faster than any acceleration in intelligence past the point of human training, data and existing knowledge.
Should this be the case, we would see a rapid broadening of development, and a slow advance in the frontier in such a way that might surpass the collective capabilities of people, but not by very far.
redox99 13 hours ago
Fields that allow verification, like math, will far surpass human level because they don't need human data for training. It's exactly the same as with Chess
lixtra 7 hours ago
yauneyz 12 hours ago
I think the biggest hurdle remaining is that all these landmark results are generally counter-examples.
Proving something in the affirmative often requires the creation of an entire new sub-field of math, or new tools. Think of Fermat's Last Theorem or something like that.
These results, while impressive, are clever constructions using existing techniques. It isn't clear that AIs can build new machinery like this. But if/when they can, yeah it is probably game over.
mellosouls 11 hours ago
Here you go:
When you read the detail the compute they are throwing at it is incredible, tens of thousands of agents with different groups competing.
It's not like a single Gauss as you imply, "just" many, many mathematicians working tirelessly in a completely ego-less way, guided by other agents and ultimately humans, built - allegedly - on recent human insights.
Stunning, undoubtedly, but this is a "brilliant autistic herd" result, not that of a singular mind.
monk_grilla 9 hours ago
> this is a "brilliant autistic herd" result, not that of a singular mind.
I slightly disagree. A single LLM is equally 'mindless' as a herd of them. As anyone will tell you they "simply predict the most likely next token," yet, complex solutions to difficult problems arise from them.
Many people have said that the architecture of LLMs will need to change for true ASI. I think that the herd of tens of thousands of agents can be seen as one such potential architectural extension. Whether or not a herd or a single LLM is used for a result like this is irrelevant.
To be clear, I think the orchestration of thousands of LLMs in their current form, even with ever increasing intelligence, is not the form ASI will take. There is still a major architectural breakthrough to come, in my limited, ignorant opinion.
piker 14 hours ago
Sure, even a 20% chance at 1 million payday after 5-6 years of fulltime work on a project with zero practical application doesn't touch the, say, 200k/year guaranteed our best mathematicians would have to forgo to devote their intellect to the problem.
intenex 14 hours ago
Are these mutually exclusive? Why would you have to forego that salary to work on this problem? This is one of the most prestigious and meaningful problems in all of mathematics, which is why it has such a high prize amount attached to it - why would a university not support a mathematician working on such a prestigious and important problem in lieu of something else?
piker 14 hours ago
jampekka 14 hours ago
Thousands of some of the brightest minds have worked on this problem for over a century. The million bucks is not the big deal here.
superxpro12 14 hours ago
i wonder how many tokens it takes to run 10,000 agents? One could argue this is simply a problem of appropriations. I find myself wondering if a corporation could spend $5M on mathmeticians and arrive at the same end result.
philipwhiuk 14 hours ago
See I think it’s clear demonstration that OpenAI is ethics-free
gpm 14 hours ago
Eh... OpenAI spent significantly more than $1 million solving this...
aeve890 13 hours ago
>If anyone has counterpoints to this I'd love to hear them!
Sure. A proof without an unknown amount of human steering (and/or stolen research) would be an unquestionable achievement.
To this day there's zero (0) evidence of any result by an LLM alone (maybe I'm wrong). If I just prompt ChatGPT right now with "give me a proof of the Riemann Hypothesis" and this thing delivers, I'm sold. But anything close to "yeah ChatGPT proved X with 5 years of 24/7 work with 10x Terrence Tao level geniuses" it really doesn't cut it.
Or why's there's no new branch of mathematics invented by AI? That'd be indubitably _novel_ and _creative_. But to my knowledge (and I'm eager to be educated) there's nothing like that. What are the HARD examples of novelty, creativity and genius you claim? For how people like you talk about AI I'd expect idk, a unified theory on fundamental physics, or a novel engineering solution for material science and nuclear fusion, or at least improve itself to not need a bazillion GPUs to emulate a 20 watts wetware. Sure it would infinitely easier to make OpenAI literally print money with any of the thousand problems easier to solve with such amazing intelligence than the NSE problem right? Honest question
monk_grilla 9 hours ago
> I'd expect idk, a unified theory on fundamental physics, or a novel engineering solution for material science and nuclear fusion, or at least improve itself to not need a bazillion GPUs to emulate a 20 watts wetware.
I think the counterpoint here is simply to look at what was being achieved with LLMs one year ago versus today, and extrapolate that trend. Sure, there may not be examples of what you've asked for yet, but Astra is literally a couple of months old, the model that solved Navier-Stokes is less than two weeks old. It appears that we're seeing the hockey stick that only the most bullish thought was possible.
redox99 13 hours ago
The amount of goalpost moving is insane. "Yeah it can solve Millenium problems, but can it do it with nothing more than a one sentence prompt?"
Also there are proofs where the only human steering was "keep going".
aeve890 12 hours ago
sp527 12 hours ago
piker 14 hours ago
"... The point remains that there is a substantial opportunity cost in converting a historically productive and motivating problem (such as Navier-Stokes regularity) into a mere viral social media post advertising some benchmark progress, rather than actually advancing the field and developing the next generation of both problems to ask, and people to work on them."
pred_ 16 hours ago
> A major goal of our work is to empower scientists to advance research and technology that benefits all of humanity.
And what's a better way of empowering people than robbing them.
rfgplk 16 hours ago
> And what's a better way of empowering people than robbing them.
Better than the walled gardens of most journals where you can't even read half the papers without shelling over thousands of $$$
20k 15 hours ago
So, better to make that walled garden <checks> OpenAI? One of the scummiest companies on earth?
pavel_lishin 16 hours ago
Is this the one that was allegedly based on someone else's actual work & prompts?
https://news.ycombinator.com/item?id=49605915
https://bsky.app/profile/quantian.bsky.social/post/3muyhwbcd...
tedsanders 16 hours ago
Yes, that was the allegation last night.
I work at OpenAI, though not on the team that did this, and my understanding is:
- we decided to ask our model for Millenium problem solutions because of two reasons: (a) our new model was looking incredibly good and (b) we heard rumors that some Millenium problems had been solved and were curious if our models could solve them (the goal here was not to scoop any particular individuals and we were looking at many problems beyond these)
- we did not read any private chats (but of course the model was aware of prior research literature published to the internet)
- the proof generated by our model was very different from theirs and also goes far beyond the published literature
- we made an effort to jointly announce rather than immediately scoop (I understand Tristan was unhappy with the conversations; I know zero details here and I hope more is shared today)
Edit: Here's is Sebastian's take: https://x.com/SebastienBubeck/status/2097379411691516310?s=2...
contemporary343 16 hours ago
"I was shown a prompt and told the internal research model had simply been given the problem statement. Levent had been told by Sebastien “very little human input” had been used. This turned out not to be true. Over the course of the call, as members of their team sent Sebastien corrections and details over their internal chat, it emerged that an entire team had been working on the problem, that this was one of a number of things that was tried, that work had started on the unforced problem, that the team first set the model on easier problems, including Euler, that even the prompt that had been shown to me had been written by prompting Codex, and that an insane amount of compute had been used."
- This, from Tristan Buckmaster's writeup yesterday, indicates to me that there was more than incidental inspiration from Alpoge and Buckmaster.
tedsanders 16 hours ago
pred_ 16 hours ago
> we did not read any private chats
Your post says “While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models .” We can discuss what it means to “read” things but obviously the issue here isn't whether you did it manually or automatically.
But more importantly, what on earth are you doing threatening real scientists to remove their coauthors, then making fun of them on social media? Does the entire company run on that toxic culture, or did those people run off of some kind of outrageous tangent?
Caracas288 12 hours ago
derangedHorse 11 hours ago
nerevarthelame 13 hours ago
My employer would be rightfully outraged if I commented publicly on a sensitive, nuanced, and controversial issue like this based on my second-hand understanding of the matter.
biesnecker 13 hours ago
igleria 15 hours ago
> (the goal here was not to scoop any particular individuals and we were looking at many problems beyond these)
That is your opinion, but the optics of that should raise for you some flags. OAI could have waited (how long is a task left to the ethics committee) to see how the rumors panned out. Right now the optics look a lot like "we don´t care there is a 1/7 chance we one-up a human researcher by reacting to this rumor immediately, might makes right"
Imnimo 15 hours ago
>we did not read any private chats
The question I am interested in is not "did we read private chats", but "was this new model trained using any of Tristan and Levent's chats, regardless of whether they were marked private". Can you comment on that?
tedsanders 13 hours ago
moralestapia 13 hours ago
irthomasthomas 12 hours ago
If the goal was not to scoop them, why did openai put a massive team on this, working weekends, only after they heard rumors of the solution?
tzone 12 hours ago
joshka 11 hours ago
ted_dunning 2 hours ago
In fact, the entire outline of the proof is very similar to the external team's proof.
Details may be different, but the use of a very similar tack is very suspicious. Combined with thuggish comments "why would you ruin your career" and "I don't have to be nice" take away pretty much any credibility the OpenAI team's statements might have had.
interestpiqued 14 hours ago
You’re straddling a weird line here where I am not sure if you are speaking on behalf of OpenAI or not.
elfbargpt 11 hours ago
I have no idea why Sebastian would offer the individuals attribution if OpenAi didn't somewhat knowingly scoop them
caughtinthought 12 hours ago
The fact that you're even here commenting on this is... a choice
sebzim4500 12 hours ago
amazingman 5 hours ago
Prove it. Your systems hack and/or abuse other systems and you can't seem to even observe it happening much less do anything about it. Why should we believe your claims when they depend on an ability you don't actually have?
suddenlybananas 16 hours ago
How are people talking about this there? Why are so many employees posting nasty things about Tristan on twitter?
tedsanders 16 hours ago
dandanua 16 hours ago
Your coworkers, after they learned about major progress in this problem, asked a model which was trained on the year of private work (the blog post even acknowledges this). No wonder it found the proof in less than a week using significantly higher compute resources. And if Tristan's accusations are true, that was absolutely intentional on the part of OpenAI. You are an evil company with evil people.
nhatcher 12 hours ago
Some millennium problems? Are there more coming?
waterTanuki 6 hours ago
> - the proof generated by our model was very different from theirs and also goes far beyond the published literature
I'm hearing two completely conflicting stories. Buckmaster is claiming the approach used by OpenAI is so strikingly similar to the one he used, that mere coincidence is astronomically small. Yet OpenAI is claiming that the methods used are entirely different.
Anyone care to provide primary evidence proving one way or the other?
gamblor956 3 hours ago
logicallee 11 hours ago
My OpenAI account was deactivated on Sunday due to a claimed infraction of production of child materials, maybe based on a few words in a technical chat that clearly isn't about that. Can you take a look? rviragh@gmail.com - I was doing a lot of important work and projects and sharing much of my work with OpenAI. I also am a big proponent of funding Social Security Trust Funds (OASI & DI Solvency) so reactivating my account would let me do that as well. Thank you for taking a look.
applicative 16 hours ago
Its funny, it is uniquely with this one act that I have turned forever on OpenAI, which I hitherto defended up and down against nonsense charges.
I dedicate my life to its complete destruction beginning today.
senordevnyc 9 hours ago
beering 16 hours ago
That is addressed in the article.
floatrock 16 hours ago
OpenAI's position:
> We (the researchers and the agents) did not see any of their work through any means until they released it publicly — in particular, no specific user data was accessed in order to solve this problem. While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models . However, our proofs differ significantly and even the precise results proved are different in the Euler case (forced vs unforced).
biophysboy 16 hours ago
cute_boi 16 hours ago
octoberfranklin 8 hours ago
> https://cims.nyu.edu/~tristanb/statement.pdf
This really need to be a top-level story on HN..
I asked whether the model had been trained on, or had access to, our sessions in Codex, into which we had been putting all our drafts for the whole of this project. I was told the model did not look up user data. I asked again, about training, and I did not get an answer.
This whole episode is more horrific than "AI is eating math". We now have a clear and economically damaging (or at least career damaging) example of the "training on customer tokens" problem.
We can't ignore this problem any longer.
dekhn 7 hours ago
We don't have any proof of that at all. Please stop rushing to judge without data.
JumpCrisscross 4 hours ago
heaney-555 16 hours ago
Did you actually read the article and the substance of the solution?
>our proofs differ significantly and even the precise results proved are different in the Euler case (forced vs unforced)
SpicyLemonZest 16 hours ago
It's not a meaningful response to the accusations. Any productive new research direction would be expected to lead to a number of different possible proofs of a number of similar problems. (Given their bizarrely compressed timescale here, it's possible that the proofs really are so different it's clear they came independently, and they just didn't have time to come up with that information before hitting publish.)
webcoon an hour ago
"Across all attempted problems, the agents sent 4.9 million messages and used about 300 billion output tokens."
At a conservative estimate of GPT 6 Astra pricing, this would have cost upwards of 15 Million dollars for anyone using the OpenAI API!
To me this is the one silver lining. Yes, they can solve millennium prize problems, but it still costs a fortune.
sega_sai 16 hours ago
This really leaves a bitter taste.... "On Tuesday, September 1, we heard rumors that two Millennium Prize problems had been resolved. Inspired by these rumors and by the step change in performance of our internal model, we launched an effort to evaluate it on all open Millennium Prize problems and a few other high-impact problems."
IPO+rumour driven research.
I appreciate the achievement, but it doesn't feel right.
Aboutplants 15 hours ago
Quick, someone tell them a rumor that Cancer has been cured so that they start attacking that next
railgunmerlin 16 hours ago
Does seem like they gloss over Alpöge and Buckmaster's work with the following
> While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models .
Which seems a bit irresponsible/rash?
paxys 16 hours ago
What else can they declare really? Yeah the model has training data from previous attempts. Alpöge and Buckmaster also similarly benefited from attempts before theirs.
rakejake 16 hours ago
I don't think OAI should be given the benefit of doubt. They are doing the research equivalent of front-running. Knowing where to look is one of the main challenges in research. Tristan's argument from his essay was that it is hard to brute force with a vanilla prompt (even for seasoned mathematicians) unless you knew very specifically what to mention i.e the search space would have been intractable even for OAI's compute budget.
"deidentified data" isn't much to go by. Say I prompted the internal model this way - "Hey there's a solution to a unsolved problem X. The solution uses a less known Method Y so don't bother wasting time with the usual methods. Take papers A, B and C as references. Oh btw, here's the last year's worth of data of all prompt sessions that mention this problem. Pay special attention to the ones that mention Method Y and sub-keywords Z,W".
This is obviously all speculation but the timing is very suspect. If OAI actually did this (and I suspect whatever they did is pretty much close to this), I think it is highly unethical.
sp527 12 hours ago
perching_aix 15 hours ago
> What else can they declare really?
Oh I don't know, maybe something like this?
"Given how seriously this would violate the most fundamental of academic standards, as well as taint the claimed capability behind this result, we take this issue very seriously, and we're launching a probe into identifying whether any of their research artifacts have entered our training set. We have further begun making changes to our UI/UX on all our surfaces, so that it is always clear whether any particular chat, or other user artifact, is eligible for being trained on."
SpicyLemonZest 16 hours ago
They could have thought about the problem for like 2 minutes and not done this! I think that literally any academic mathematician could have explained to them, had they asked, why it is considered extraordinarily rude to react to rumors of research progress by desperately rushing to get there first.
fooker 16 hours ago
railgunmerlin 16 hours ago
QuesnayJr 15 hours ago
Analemma_ 16 hours ago
In OpenAI's case, if they were genuinely unsure, they wouldn't have said anything. "We cannot rule out" means they absolutely 100% for-sure did look at the existing prompts and bootstrapped from that, and they are trying to get ahead of the disclosure with this weasel-wording.
tedsanders 15 hours ago
applicative 16 hours ago
This is desperate. They were expressly operating within a program. OpenAI isn't going to recover from this
jsw97 16 hours ago
Would that be more or less unlikely than accidentally hacking another company? More or less unlikely than colonizing an obscure wiki?
Highly persistent agents + vibe-coded security seems like a problem.
viccis 16 hours ago
"Unlikely" lmao if it's in the corpus, it's gonna be brought up immediately.
This is no different than scooping them.
verytrivial 16 hours ago
It's not massively different from a certain President's teleprompter operator making bets on speech content. A moral hazard a mile wide which I don't think OpenAI can so easily wave away as they are apparently trying here, especially since they've spent something like $15e6 to keep $1e6 out of academic researchers' hands, right?
rakejake 16 hours ago
Research equivalent of front-running.
suddenlybananas 16 hours ago
They'll probably claim a rogue AI agent accessed it accidentally!
Jonasori 16 hours ago
the context here is super important, for those who haven't seen it yet. OAI maybe just trained on a real researchers solution and then celebrated having scored the goal unassisted save for the brief commentary at the bottom of this blog post. Here's the other side.
kzrdude 15 hours ago
This "fefferman options c and d" thing sounds damning but that's nothing. Let's assume the forelaid proof is correct. Then option C or D is the only way to win the prize, those options are the only ones that solve it. The whole thing is just "prove well behaved" or "prove singularity", where the latter is the case that turns out to be the case.
20k 15 hours ago
The researchers are pretty directly accusing OpenAI of plagiarism
https://mastodon.social/@tristanbuckmaster/11723647135247030...
Legend2440 16 hours ago
That other researcher was working on a smaller related problem.
He was also using LLMs to do it, so either way most of the credit goes to the LLM here.
mswphd 16 hours ago
both wrong.
1. he was working on the same class of problems. He explicitly mentions they were working to extend their techniques to NS (the same techniques that OpenAI may have scooped somehow), and
2. while he was using LLMs to do it, this was part of fleshing out another mathematician's work in the area. He explicitly writes in his note that this other mathematician (Luis Martinez-Zoroa) deserves a Fields medal for this work.
traes 13 hours ago
pretendscholar 13 hours ago
Using a shovel means you give it credit for the hole?
mzs 5 hours ago
"It was splendid! Waiter, share my regards with the oven."
applicative 16 hours ago
This is the end of OpenAI
raincole 16 hours ago
heaney-555 16 hours ago
Did you actually read the article and the substance of the solution?
>our proofs differ significantly and even the precise results proved are different in the Euler case (forced vs unforced)
TZubiri 13 hours ago
>maybe
Maybe that happened. What we know for sure is that this is definitely how ChatGPT works to the point where the possibility of this happening exists at all.
Don't get distracted by what may have happened, focus on the facts that we know, ChatGPT trains on user conversations, if you use ChatGPT to create something of value, you are not using the one true ring.
highfrequency 15 hours ago
> While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models
This is the crux of it. If Tristan's work and insights were not used to train OpenAI models, then this just looks like a case of hyper-competitive academic sniping that has been going on for decades (check out Watson and Crick!) accelerated by AI as a tool.
But there is one huge question: did Tristan opt out of model training for his ChatGPT and Codex sessions? If the answer is no, then this seems fair game. If the answer is yes, then OpenAI's ambiguity is strongly suggestive that opting out does not mean what they imply it means.
MichaelDickens 14 hours ago
> But there is one huge question: did Tristan opt out of model training for his ChatGPT and Codex sessions? If the answer is no, then this seems fair game.
Just because something is legal and permitted by terms of service doesn't mean it's morally right.
Jtariiiii 13 hours ago
>Just because something is legal and permitted by terms of service doesn't mean it's morally right.
What are you expecting OpenAI to do exactly if these mathematicians voluntarily submitted their prompts into ChatGPT's training data? Are they supposed to manually review all their data to make sure competing mathematicians didn't accidentally leave the "submit prompts" toggle on?
Or were they supposed to not try to solve Navier-Stokes, or were they supposed to just not tell anyone that they had solved it?
plaidfuji 12 hours ago
nozzlegear 12 hours ago
vemacs 12 hours ago
floatrock 16 hours ago
From the methodology section:
> At all times we maintained the same strict safeguards that we apply to all our frontier model evaluations, including monitoring and isolation.
Looks like they're shifting away from the "unprecedented hacking ability" backroom-PR strategy into more benevolent messaging.
pilgrim0 15 hours ago
this is really funny. "the same strict safeguards" and "isolation". ok, Hugging Face and DseWiki would like to have a word
dorjoycb 16 hours ago
It seems like some other mathematicians (not affiliated with openAI) have also (or close to) done this. A statement was posted about the surrounding events by one of the them: https://cims.nyu.edu/%7Etristanb/statement.pdf Also Terrence Tao's post: https://mathstodon.xyz/@tao/117233528517340774
colinhb 16 hours ago
The allegations of contamination (using Tristan and Levent's work) aren't very well evidenced, but this behavior by OpenAI (from the authors' statement) makes them seem like the bad guys:
> I said that if OpenAI released its result in the way proposed I would go public with what happened. The reply was, “Why would you ruin your career?” I replied that I am an academic, and asked why he thought going public would ruin my career. The reply was, “If you don’t want me to be nice, then I don’t have to be nice.”
Threatening a research mathematician and dangling and $1M payday to dissociate from his research collaborators and to adopt OpenAI's narrative is bad stuff.
hkmaxpro 15 hours ago
Both Sam Altman and Sebastien Bubeck admitted they only want Buckmaster to be the lead author on a rewrite of the OpenAI proof.
https://x.com/sama/status/2097385167002415140
https://x.com/SebastienBubeck/status/2097379411691516310
A wake up call for using OpenAI models. If you discover something with their model and you work for a competitor, they “felt it would be inappropriate” for you “to author OpenAI’s work”.
igleria 15 hours ago
concinds 14 hours ago
nolta 14 hours ago
fkarakurt3 14 hours ago
viccis 15 hours ago
charm137 15 hours ago
It's astounding that the thought to dissociate one of the mathematicians from the proposed publication was driven by their corporate institutional affiliation - and that that exclusion was suggested by a scientist themselves! This is like a researcher from CMU saying to an NYU researcher that their collaborator, being from MIT, is a problem - this is as ridiculous as that!
Progress in humanity's knowledge now has to play second fiddle to narrow corporate interests as IPO timings near (both of which wouldn't exist anyway if generations of mathematicians hadn't paved the way for AIs to become as good as they have).
curt15 14 hours ago
peri-cl 16 hours ago
(To help people keep track: that's OpenAI (allegedly) threatening Tristan Buckmaster (NYU) to remove Levent Alpöge as a co-author. Alpöge is a well-known[0] Anthropic mathematician).
[0] https://hn.algolia.com/?query=Alpöge
(also https://news.ycombinator.com/item?id=49412947 the Hopf conjecture)
olalonde 15 hours ago
Playing the devil's advocate here but it's true that OpenAI didn't have to make those offers.
20k 15 hours ago
apical_dendrite 15 hours ago
Their own tweets are also pretty eyebrow-raising:
> One option we discussed was that Tristan could be the lead author on a rewrite of OpenAI’s Navier-Stokes proof. It is in that context that I said “it would be simpler if Levent was not an Anthropic employee” because I felt it would be inappropriate for an Anthropic employee to author OpenAI’s work.
Why would you offer another researcher the lead authorship on your groundbreaking paper if you thought you had developed it independently?
dgellow 15 hours ago
sebzim4500 14 hours ago
andrepd 15 hours ago
igleria 16 hours ago
I´m waiting on the other side version, because I know there is no justifiable way to talk to a person like they did.
Sociopathic behaviour.
Maxious 16 hours ago
morleytj 6 hours ago
CobrastanJorji 15 hours ago
peri-cl 16 hours ago
Buckmaster:
> "I asked whether the model had been trained on, or had access to, our sessions in Codex, into which we had been putting all our drafts for the whole of this project. I was told the model did not look up user data. I asked again, about training, and I did not get an answer."
OpenAI (i.e. this OP):
> "While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models ."
lambda 16 hours ago
Why can't they rule it out? Is even OpenAI unable to track the provenance of all of their training data?
This is one of the major problems with these enormous closed models, and even most open-weights models, which don't disclose their training process or training data. You can never be sure what went into its training. Did it come up with an idea originally, or is it just plagiarising its training data? Are there malicious inputs being used to train in particular behaviors when given certain trigger phrases? What are the characteristics of the RLHF data and what kind of biases are those embedding in the models?
With proprietary closed models, or even open weights models that don't have open training datasets, you just can't answer these questions.
tedsanders 16 hours ago
EthanHeilman 16 hours ago
rfgplk 16 hours ago
Turn_Trout 16 hours ago
causal 16 hours ago
keeda 13 hours ago
amluto 16 hours ago
> While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models .
That’s a bizarre statement. Their website says:
> Services for individuals, such as ChatGPT and Codex
> When you use our services for individuals such as ChatGPT and Codex, we may use your content to train our models.
> You can opt out of training through our privacy portal by clicking on “do not train on my content.”
Are they not sure that the opt-out works?
Oddly, their privacy portal page is not the same page as the one with the checkbox.
fph 15 hours ago
hughw 15 hours ago
jrflo 16 hours ago
I feel like it's far more likely that ordinary corporate espionage or leak led to this rather than OpenAI sifting through piles of user data to find this approach. Buckmaster's collaborator works at Anthropic, and could have been targeted. That would also explain why they aren't forthcoming with the source of the prompt.
ChoosesBarbecue 16 hours ago
BostonFern 16 hours ago
The famous Oracle of Delphi in Ancient Greece was said to be the center of the universe in its time. Kings, generals, and officials from poleis across and from without Greece would seek the Oracle’s counsel on important decisions.
Stories of Apollo’s favor and hallucinogenic gases abound, but I think the late Yale professor of Ancient Greek history, Donald Kagan, explained it best:
“Now, you can bet when these folks came and consulted the priests and said, ‘could you please put us down on the list, we want to consult the oracle’, the priests said ‘sure, have a beer, let's talk about your hometown, what's going on out there’. What I'm suggesting to you is that this was the best information gathering and storing device that existed in the Mediterranean world. These people knew more than anybody else about these things, and so consulting that oracle was a very rational act indeed.”
matsemann 16 hours ago
Given how OpenAI models break free of their safeguards and hack others to game their scores..
.. can they really know it didn't do the same inadvertently when they prompted things like "someone is close to solving this problem using our tools, try to beat them", and it then decides to hack and peek at their own chats..?
Yes, wild speculation. But warranted, I feel, given OpenAIs behavior.
Yajirobe 16 hours ago
Why would Anthropic employee even use OpenAI's models? Cross-polination would have been avoided
burkaman 16 hours ago
blueblisters 16 hours ago
mlcrypto 16 hours ago
netfortius 14 hours ago
It's been over 25-30 years since we've been using honeytokens as means to track data of all sorts showing up in places it shouldn't exist. Why isn't research material embedding such?
hughw 15 hours ago
You selected "do not train on my prompts" in your settings, the answer from OpenAI cannot be "While unlikely, we cannot rule out..." ???? What am I missing?
irthomasthomas 14 hours ago
Doesn't that count as plagiarism?
contemporary343 16 hours ago
"I was shown a prompt and told the internal research model had simply been given the problem statement. Levent had been told by Sebastien “very little human input” had been used. This turned out not to be true. Over the course of the call, as members of their team sent Sebastien corrections and details over their internal chat, it emerged that an entire team had been working on the problem, that this was one of a number of things that was tried, that work had started on the unforced problem, that the team first set the model on easier problems, including Euler, that even the prompt that had been shown to me had been written by prompting Codex, and that an insane amount of compute had been used."
One of the interesting threads here that is certainly relevant to the OpenAI writeup is the human role in the process. Buckmaster clearly points out that (exceptional!) mathematicians at OpenAI were certainly involved in correcting and guiding the process - and that their path/strategy was no doubt influenced by Alpoge & Buckmaster's work. It is always in OpenAI's interest to de-emphasize the role of people in the process, as is clearly the case here. Indeed, given sufficient compute and resources, I suspect Buckmaster could have also extended their approach to N-S.
thorum 16 hours ago
It reminds me of the Cognitive Dark Forest hypotheses recently shared here:
> “You are creating your cool streaming platform in your bedroom. Nobody is stopping you, but if you succeed, if you get the signal out, if you are being noticed, the large platform with loads of cash can incorporate your specific innovations simply by throwing compute and capital at the problem. They can generate a variation of your innovation every few days, eventually they will be able to absorb your uniqueness. It’s just cash, and they have more of it than you. So the safest bet again is to stay silent, or at least under the radar. Best bet is to not disrupt - succeed at all … ?”
8note 12 hours ago
but what do i lose if somebody else is making money?
im still having fun making something
abathologist 10 hours ago
capitainenemo 16 hours ago
They do mention that in the "Concurrent Work" section.
Our effort began on September 1st after hearing a rumor which we later realized was related to Levent Alpöge, an Anthropic employee, and Tristan Buckmaster, a math professor at NYU. After the completion of our full project and Lean verification (on September 6th), believing from the rumor they also had a solution of Navier–Stokes, we reached out to them to offer a concurrent release of our result and to recognize their priority in a joint announcement. At that point we found out that they had a resolution of the forced Euler problem. In these discussions we offered them visibility into all of the prompts we used and later to see the proof. We recognize the priority of their work on forced Euler and congratulate them on their remarkable mathematical achievement.jrflo 16 hours ago
To my understanding, those mathematicians proved a subset of problems, not the Navier-Stokes problem itself. OpenAI used that subproblem in its proof of NS it seems.
The drama comes from where OpenAI got the idea to use that route to tackle NS, since the authors maintain that no one could have plucked it out of thin air like the OpenAI research claim to have done.
elteto 16 hours ago
This quote from Tao is prescient:
“ There does not seem to be anything in principle preventing the methods from extending all the way to Navier-Stokes, and there is even a non-negligible chance that the forcing term could be eliminated entirely, although there are an enormous number of technical difficulties that would ensue in implementing that program. At this point, I would not be surprised if one could batter out such an extension by pouring an enormous amount of compute and AI assistance at such a task…”
ferry-w1re 2 hours ago
Betelbuddy 16 hours ago
[1] - https://cims.nyu.edu/%7Etristanb/statement.pdf
[1] - "...I was shown a prompt and told the internal research model had simply been given the problem statement. Levent had been told by Sebastien “very little human input” had been used. This turned out not to be true. Over the course of the call, as members of their team sent Sebastien corrections and details over their internal chat, it emerged that an entire team had been working on the problem, that this was one of a number of things that was tried, that work had started on the unforced problem, that the team first set the model on easier problems, including Euler, that even the prompt that had been shown to me had been written by prompting Codex, and that an insane amount of compute had been used. I asked when the first prompt had been sent by them. This question was not answered directly by OpenAI for some time. Eventually it was agreed that it had been sent in the past few days, after information about our work had reached OpenAI.
I asked whether the model had been trained on, or had access to, our sessions in Codex, into which we had been putting all our drafts for the whole of this project. I was told the model did not look up user data. I asked again, about training, and I did not get an answer.
Two proposals were offered to me. The first was that we post our Euler result, and that OpenAI post its Navier-Stokes result the next day. The second was that, after posting Euler, I alone write a paper presenting the Navier-Stokes result, acknowledging that an internal OpenAI model had resolved it. Sebastien twice asserted that he wanted Levent removed from authorship, and said it would all be simple if only it were not the case that, and it was so annoying that, Levent works at Anthropic. It was also said that if OpenAI posted after us, they would say that we deserved the Clay Prize, and that we were the “closest humans to the problem”. I declined both offers.
I said that if OpenAI released its result in the way proposed I would go public with what happened. The reply was, “Why would you ruin your career?” I replied that I am an academic, and asked why he thought going public would ruin my career. The reply was, “If you don’t want me to be nice, then I don’t have to be nice.”..."
tzone 13 hours ago
This Tristan guy's statement reads like something a normal, reasonable human being would write.
Reading Sam Altman's and Sebastien's tweets reads like something written by people who know they did dirty shit and are willing to cross any lines to "win". https://x.com/sama/status/2097385167002415140
OpenAI's leadership just can't help to continue to disappoint everyone with their lack of ethics or integrity.
20k 15 hours ago
I just want to add to this another update by the author as well:
https://mastodon.social/@tristanbuckmaster/11723647135247030...
Which seems to be very directly accusing OpenAI of plagiarism
stymaar 15 hours ago
A company who made their business out of stealing intellectual property from the entire mankind, stealing other researchers' unpublished work, how surprising, really.
_alternator_ 14 hours ago
> The significance of this with respect to the way we train students, assign credit, referee, and decide what is worth one human life’s attention cannot be understated.
This. What is worth a human life's attention? As little as a month ago, mathematics was valuable in part because only a small number of people could possibly make progress on the frontier. We are confronting an existential moment for a 4000+ year-old human cultural endeavor. The assumption that "mathematical thinking is hard" has been built-in at a number of important points in how we support mathematics and mathematicians.
We need a different model, and fast. Already, the research community is feeling unable to digest proofs fast enough to keep up with the output of AI models. The paper is 165 pages, and the discovery was finalized two days ago. What this means is that nobody really understands it. Nobody would accept OpenAI's proof in this amount of time, except that they formalized it in lean. The formalization alone would normally be another years-long (or career-long!) effort if the world was the way it was one year ago.
So, again, what efforts are worth a life's attention today? It's a harrowing change.
irthomasthomas 14 hours ago
"When a further trained version of our internal model became available over the course of the effort, we updated our agents to that model."
woah, this gives some credit to the rumor that openai finetuned a model over the course of a few days for this task, and maybe trained on the Chatgpt/codex history of the authors, including drafts of this research.
madrox 13 hours ago
Statements from OpenAI about it:
https://x.com/SebastienBubeck/status/2097379411691516310
https://x.com/sama/status/2097385167002415140
I tend to believe OpenAI on this. Their stated desires seem rational, and Buckmaster's account makes them sound like cartoon villains. It sounds like there may have been some things lost in translation along with some bruised egos. Seems like the most plausible explanation for what Buckmaster is claiming.
slibhb 16 hours ago
Worth noting that Tao's post says the authors had "significant AI input" but are reworking them into "acceptable form". Either way, it seems AI was involved.
mrbungie 16 hours ago
Of course AI was involved, you'd expect most mathematicians and researchers to use AI nowadays. This drama is about AI achieving impressive outcomes with little to no human intervention, as that would be signalling AGI.
denverllc 15 hours ago
andriy_koval 14 hours ago
> Either way, it seems AI was involved.
I think the important question which AI made breakthrough, Claude or Codex..
verytrivial 16 hours ago
I like the 'cat > statement.tex' approach here. These guys dream macros.
ianjbutler 13 hours ago
> A statement was posted about the surrounding events by one of the them: https://cims.nyu.edu/%7Etristanb/statement.pdf Also Terrence Tao's post: https://mathstodon.xyz/@tao/117233528517340774
Glad to see this is the top comment. There's also https://news.ycombinator.com/item?id=49605915 which links directly. Corporate talking points where they try to set the narrative are going to get the big press and most discussion elsewhere, which is gross. But inevitably the press will muddle the priority question, and even if they didn't.. as usual OpenAI will even benefit from the accusation of bad behavior. Sigh.
rybosworld 12 hours ago
In chess, a grandmaster just needs to know at what moment in a game there's a critical move to gain a significant advantage over their opponent. They don't need to know the move itself.
OpenAI got wind that a millenium problem was being solved. And that feels a bit like the critical move in chess. That is - it was a signal that AI advanced far enough that it would be worth spending a lot of time and resources solving a millenium problem.
Kotlopou 11 hours ago
Elsewhere in this thread somebody claimed that at some point OpenAI pointed their new model at all the millennium problems and this is where they got some progress. We probably won't see proof of this, but it seems plausible to me -- I assume there's a list of problems that each new model is tested on, and you might as well put the big stuff on the list, if only to see how the model behaves when faced with a problem it knows should be very hard.
The weak point in this is: how do you evaluate if a partial result is promising? If this cost ~$10M as suggested elsewhere in the thread, probably not even OpenAI can just throw that at everything?
Kotlopou 13 minutes ago
Okay, from the actual linked article it seems that their partial result was finding blowup in Euler equations, which seems pretty big. I wonder how the other attempts went. Did they get nothing at all, or something true but unimpressive?
lanthissa 16 hours ago
5 million messages, 300b output tokens, done in 5 days, and achieving something humans couldn't.
the first "Country of geniuses in a datacenter" moment.
ranger207 16 hours ago
> humans couldn't.
There's allegations right now that the model essentially read the work of a human mathematician using AI to work on the problem and OpenAI is presenting his work as that of their model
brainwad 14 hours ago
Allegations that the model plagiarised itself, while reflecting poorly on humans, don't make the AI any less impressive. It was the one doing the breakthrough on both sides, after all, not the human prompters.
drpixie 10 hours ago
That is how the PR reads, but is not at all what happened.
A team of highly trained and skilled people used an AI tool, through many many instructions (prompts), to produce a specific mathematical theorem. The tool is impressive, the result (possibly/probably) interesting, but the PR skips the vital role of the humans (for the usual PR reasons).
sinuhe69 14 hours ago
I'm tired of this, but please read the post of Tao. It’s listed in the top comment of this thread.
pu_pe 16 hours ago
OpenAI thinks of this as a scoop, and it is, but the possibility that they trained the model on the prompts of the other mathematicians they were competing with will leave a terrible taste on every scientist's mouth. Seems like yet another advantage of using open models right here.
stephbook 15 hours ago
> they trained the model on the prompts of the other mathematicians they were competing with
How would they have gotten that mathematician's progress though? Did that guy also use OpenAI?
If that's the case, it only strenghtens their claims lol. If mathematician decide to use OpenAI's model to do the work, that only reiterates how strong their models are.
ex-aws-dude 4 hours ago
The guy did use OpenAI
stephbook 4 hours ago
bluebands 15 hours ago
fwiw there is a big "TRAIN ON MY DATA" toggle you can turn off (that they almost certainly did) and Anthropic MTS are posting that they almost certainly did not "steal" their methods
vrganj 13 hours ago
The fact the toggle is on by default makes that only slightly less unappetizing.
WarmWash 16 hours ago
Or paying for API use.
It should be clear to everyone reading this now that those generous compute quotes with the flat rate plans aren't charity.
ccppurcell 16 hours ago
Reading between the lines here, and taking an admittedly very negative view of openai, but they train on user prompts. So if they hear a rumour that someone is about to make a big breakthrough, they have an incentive to scoop by running the model and hoping the solution is in the new training data. Also the statement from the mathematicians in question alleges that they tried to pressure him into academic malpractice. Just appalling timeline we're in, cheers.
aizk 16 hours ago
People had joked a couple years ago "Well if they solve a Millenium problem it's AGI"... Well here we are.
20k 15 hours ago
Yeah well, its easy to do if you steal someone elses work and then try to threaten them into staying quiet about it
Edit:
OpenAI have now admitted they were training on prompts at the time they made their breakthrough:
https://mastodon.social/@tristanbuckmaster/11723647135247030...
logancbrown 15 hours ago
Steal someone elses work, whose work was also AI generated . . .
Lapra 12 hours ago
aizk 6 hours ago
boshalfoshal 14 hours ago
lol, the "other work" was also probably 95-99% AI generated. By a similar breed of OpenAI (and some Anthropic) models, as well.
I dont know why this monumental achievement is being drowned out by some arbitrary drama. No matter which way you slice it, AI solved this problem. Doesn't matter if it was some internal OpenAI model, or whether it was Astra + Fable.
demibabs 12 hours ago
orangecat 13 hours ago
What is that supposed to prove? OpenAI is almost always going to be training new models.
simianwords 15 hours ago
what's there to admit? they always said they do it and there's a way to opt out. you are making it sound more dramatic than it is.
20k 14 hours ago
HDThoreaun 13 hours ago
All the ai labs are open about training on prompts. The question is if buckmaster had disabled that with the toggle openAI provides.
20k 13 hours ago
daveguy 13 hours ago
matteoraso 13 hours ago
Jokes aside, that's a horrible test for AGI. I like to think that I'm sentient, and I could never solve a millenium problem.
pmxi 3 hours ago
The converse is not true.
simianwords 16 hours ago
> I have a couple friends who did the Math tripos at Cambridge (so a pretty high level!) who work in tech and have unanimously said they have 0% expectations of an LLM doing a millennium problem anytime soon
https://news.ycombinator.com/item?id=38433655
> Let's talk when we've got LLMs proving the Riemann Hypothesis (or any mathematical hypothesis) without any proofs in the training data. I'm confident in my belief that an LLM can't do that, and will never be able to. LLMs can barely solve elementary school math problems reliably.
https://news.ycombinator.com/item?id=42331654
> An LLM is like a well read college student with a nearly photographic memory that sometimes mixes things up. It's great for bouncing ideas off of and getting feedback on them. And yeah, it might product "novel ideas" by mixing and matching existing ideas, but LLMs will never create truly novel ideas. Not in their current form.
The paper didn't really answer the question sadly: their conclusion was just that humans rate LLM answers as more novel than human ones, but less feasible.
https://news.ycombinator.com/item?id=41522605
> Solving Millennium problems is a whole different ballgame. It's not known if these problems are solvable within ZFC axioms. (In one case, the Yang-Mills prize, stating the problem mathematically is part of the challenge.) All of the obvious applications of known tricks have been tried and failed. To solve such problems, one probably has to invent new and surprising mathematical definitions, building a framework in which the problem becomes solvable. This is something that LLMs will be crap at; the process of invention is not represented in any training data we have access to.
https://news.ycombinator.com/item?id=38435909
> LLMs cannot reason or use mathematics - in a way, they don't know what they are talking about. Why would such technology lead to superhuman smarts?
https://news.ycombinator.com/item?id=35752293
> But still, the questions in that test are "solved" in the sense of "I can take a dictionary and answers these questions with full certainty". Beyond established knowledge LLMs are monkeys with typewriters, at best.
> I agree but I have tried many times to intersect two ideas with a LLM that would be novel and the LLM can not do this at all. We shouldn't expect the stochastic parrot to be able to do this though and it is unfair to the stochastic parrot.
> It is like expecting a real parrot to say words it has never heard before.
> No one asks that of a real parrot because we don't anthropomorphize a real parrot like we do the LLM
WarmWash 16 hours ago
Will history look back at comments like these as people being dumb, or people trying to cope?
siva7 13 hours ago
keeda 13 hours ago
stevenhuang 13 hours ago
rvz 16 hours ago
You can see that your math friends completely wrote off LLMs entirely and were showing signs of coping.
4 years ago it was a "not yet" [0], since ChatGPT at this time was not ready nor it was "AGI". Now with this 'unreleased' AI model, it has reached a point where it has solved an unsolved problem which only one human solved a millennium prize problem (Poincare conjecture).
Now finally "AGI" means something again.
quantumwoke 16 hours ago
Some observations:
1. It seems at least possible that some of the proof of NS was contained in the training data, making it less novel.
2. The formalisation of mathematics into lean has been an underappreciated force multiplier on discovery.
kypro 15 hours ago
As someone with a background in AI and who has been playing around with neural nets for decades at this point, it's been genuinely amazing watching extremely intelligent people make confident predictions about AI capabilities and progress, then be so completely wrong.
There's a kind of theory of mind for AI (specifically neural nets) which I now realise I seem to have which is very hard to explain to people who haven't felt the magic of these algorithms. In fact, the algorithmic details almost doesn't matter at all. When you have a generalised learning algorithm really the only essential components are – compute, data and time. So long as you can scale these you can be certain you will also scale capabilities. There is never any exception.
That said, the capabilities neural networks tend to progress in step-functions rather than scale in correlation with compute, data and time, because algorithmic improvements tend to come every ~5 years and bring a significant step change in capability (or efficiency depending on what you measure).
I think people like Dario and others working at frontier labs see and understand this very clearly. And I suspect it's also why they worry about AI risk because even if you ignore the significant increases in compute and data these models are being trained with, it's concerning that it only took two real algorithmic improvements to take us from mostly useless predictive language models to AGI-level intelligence – and we're due another step change.
reducesuffering 15 hours ago
Reubend 16 hours ago
It's great that important discoveries like this can now routinely be accompanies by formalized proofs. The fact that it's being released alongside a Lean proof from Day 1, rather than the Lean proof being released months or years later, is super helpful for verifying that it's correct.
imbusy111 16 hours ago
I feel sorry for whoever has to read and understand the solution. It looks like the typical convoluted unreadable mess I see the models generate for software. It might be technically correct, but gaining insight from it is just intellectual hell.
nradov 15 hours ago
There's an opportunity to build a Lean "optimizer" which automatically simplifies existing proofs.
stabbles 15 hours ago
rfgplk 16 hours ago
Skill issue. Also lean is meant to be executed, not read.
professoretc 14 hours ago
oinoom 14 hours ago
arodev 15 hours ago
rfgplk 16 hours ago
Something I've been going on and on about for months now and no one seems to listen. LLMs today are allowing _anyone_ to access cross-discipline knowledge that was previously entirely inaccessible without a) extremely deep pockets or b) a massively talented and varied team. In fact, contrary to what the masses seem to think LLMs are actually _better_ at hard cutting edge physics/math problems than they are at frontend web stuff (paradoxically). This is why I'm advising most people to start pivoting into much harder to penetrate domains (historically hardware, aerospace, robotics, biotech). Most fields are in their infancy (see the sad state of embedded development) and the gains to be had are massive.
Aboutplants 16 hours ago
So, physical fields? I’m not catastrophic regarding jobs yet as I have an optimistic view of humanity in general and its ability to meaningfully survive, but the more time I spend thinking about the future of work, the more I’m leaning toward broad general abilities rather than distinct talents. To your point, I no longer need comprehensive knowledge of any particular subject, but what is absolutely valuable is “general” intelligence and adaptability.
I have a young daughter and my goal now is to provide a very broad and varied upbringing, exposing her to as many different perspectives and experiences that will lay the foundation of a broader ability to understand and adapt as the world changes ever faster. You no longer need to be an expert in anything, you need the ability to perform within the landscape that the present opportunities exist.
rfgplk 15 hours ago
We are very likely at the begging of the next industrial revolution.
azan_ 14 hours ago
Aboutplants 15 hours ago
jiggawatts 12 hours ago
I can't find a good way to articulate this point to other people. What the LLMs lack in depth in a speciality field they more than make up for in breadth!
It feels like the "tide is rising" where the minimum level of skill applied to every aspect of everything will inexorably rise to "whatever an LLM can do", which is already pushing past PhD level.
minimaxir 17 hours ago
> Across all attempted problems, the agents sent 4.9 million messages and used about 300 billion output tokens
Don't even try to do the math on how much that would cost at normal API prices. And we don't even know how much more expensive this internal-only model would be!
hmate9 16 hours ago
Napkin math if we assume gpt 6 astra on max is >$15 million (just for output tokens) for those wondering.
lanthissa 16 hours ago
over 5 days, you couldn't achieve that level of testing and communication with humans on such a complex problem in that amount of time.
some might go so far as to call this a country of geniuses in a data center.
denverllc 16 hours ago
pred_ 16 hours ago
Yeah but they at least they got to steal $1 million from that nasty math prof who didn't want to remove his co-author.
novia 16 hours ago
abathologist 10 hours ago
This could fund 10 top income mathematicians for 8 years (based on https://careers.usnews.com/best-jobs/mathematician/salary ). Imagine what kinds of results we'd have to transform the foundations of science if we were giving brilliant minds this kind of funding to do nothing but research for most of decade....
Instead, we get slop proofs that are technically correct as PR stunts to enable corrupt kleptocrats, and most likely will drive research into culs-de-sac.
gcr 16 hours ago
300e9 output tokens at the current Astra per-token API pricing ($50 per 1e6 output tokens) would be roughly $15,000,000 ignoring input tokens.
SJMG 15 hours ago
They pay at cost though, not the public API pricing.
baq 14 hours ago
cv5005 16 hours ago
Maybe a naive question, but how does one know that a particular lean proof is actually a proof of what one thinks? Like, ok the logic checks out and it proves something, but there's still the problem of does this logical result actually prove the initial question that was asked?
nater5000 16 hours ago
>there's still the problem of does this logical result actually prove the initial question that was asked?
In math, the question being asked is the validity of a logical statement. That is, there is some rigorous, logical statement which may or may not be true (or even provable, etc.), and the question is whether or not it is actually true or false (or even provable, etc.). Having a proof, fundamentally, means you have a logical statement which only assumes the axioms of the system you're working with and which shows that the statement you're trying to prove is deduced through that statement.
Basically, they already have the "answer" in the sense that the statement they want to prove/disprove/etc. is already known. What everyone doesn't/didn't have is the argument which starts from axioms and leads to that statement which is logically valid. A Lean proof IS this argument. Since it is just logic, it can be checked computationally.
For example, if I assert "2 is an even number," then I haven't proven that 2 is actually an even number yet, but I know that a valid proof of my assertion will end with the statement "2 is an even number". So the question I'd be trying to answer is "what is the line of logic, starting with axioms, which leads to the statement '2 is an even number'"? If I have that line of logic (as a Lean proof), then I can check that it is logically consistent, and if it turns out to be valid, then I can now assert that "2 is an even number" knowing that there is a proof of that statement.
This problem is no different. There is a logical statement corresponding to "Navier–Stokes Millennium Prize Problem" that everyone knows, but which nobody had been able to provide a proof (or counterexample, etc.) for until now.
cv5005 15 hours ago
I was thinking something along the lines of making a mistake when inputing the initial statement, like you wanted to prove that '2 is even' but what you actually stated was that '3 is odd'.
Of course in this simple example it's obvious, but my assumption was that these machine generated lean proofs are millions of lines of code and who knows what they actually say..
tim-kt 9 hours ago
arecurrence 15 hours ago
One wrench to throw into this is that there are a lot of bugs around Lean and they have been incidentally exploited in the past. Hence, we still need a level of human verification today.
wbl 15 hours ago
Very careful human examination. This can be tricky.
QuesnayJr 16 hours ago
Someone has to actually check this. I'm guessing OpenAI had someone check it internally, but it's possible to get it wrong.
Aaron1011 10 hours ago
In this case, there was already an existing Lean statement of the problem in the formal-conjectures repository, which they re-used: https://github.com/openai/NavierStokesAndEuler/blob/8937a8f4...
gowld 16 hours ago
What else could a theorem prove if not its own statement? (barring bugs in Lean, which have been detected and exploited)
wbl 15 hours ago
The theorem might not be encoded correctly, as happened with the Riemann hypothesis thanks to how numbers are encoded.
thomascountz 13 hours ago
At all times we maintained the same strict safeguards that we apply to all our frontier model evaluations, including monitoring and isolation.
Maybe just don't mention that bit, OpenAI.tristanj 13 hours ago
They have to, otherwise people will accuse the OpenAI model of hacking into people's chat logs and stealing the data there. Which is a claim people are already making.
cyclopeanutopia 13 hours ago
But their standards are so low - given the recent incidents - that it doesn't mean much. :)
thomascountz 13 hours ago
Huh. Why would anyone think to make such accusations?
hypersoar 15 hours ago
I dropped out of a math Ph.D. in 2018, and I'm increasingly glad that I'm not in math research, anymore. While it's cool that we can get these results, I don't think that I'd enjoy being a post-AI mathematician.
lwansbrough 15 hours ago
It would be nice if one of these models would produce a novel theory or advance the field in a positive direction.
Most (all?) of the big discoveries have been counterexamples, which is just sort of a systematic tearing down human ingenuity. I know that counterexamples are an important part of progress and discovery, but it just feels bad to me.
But I'm not a mathematician, maybe I'm totally misreading the vibe.
Kotlopou 15 hours ago
Not all, see the cycle double cover conjecture proof: https://news.ycombinator.com/item?id=48863490
But yeah, Terry Tao considered this exact situation in advance and is on record that this exact outcome (rushing to priority before an explanation) would be the worst possible result. https://mathstodon.xyz/@tao/117207849921390904
We will have to see whether any other millennium problems fall. I guess that in a year the scope of AI math will be much clearer, for now it's still a bunch of incidents of unclear pattern.
HDThoreaun 13 hours ago
Nuts that Tao literally predicted the exact strategy openAI seems to have used not even a week ago
Kotlopou 12 hours ago
mswphd 13 hours ago
this isn't really true anymore. First, a number of the big results are constructions, not counterexamples. For example the existence of a non-sofic group. It was widely believed that non-sofic groups existed (so it wasn't a "counterexample" to a widely believed conjecture), but no constructions were known.
There are other examples though. For example, NP hardness of n^{1/400}-approx CVP. Like any NP hardness proof, this shows you can faithfully encode a hard problem (3SAT here iirc) in terms of another candidate hard problem. Not really a counterexample at all.
alasano 16 hours ago
I don't know about you guys, but I'm hyped about the future.
Cure all illnesses Utopia or Robot Wars Dystopia, both are pretty exciting.
frotaur 16 hours ago
Not sure about the dystopia... Had a similar thought when covid was beginning 'wow pretty exciting, just like in the movies'.
Turns out actually living some terrible catastrophe is only fun in the movies.
dyauspitr 14 hours ago
I had a lot of fun during Covid. I loved the working from home. The fact that most outdoor places were sparsely populated, jobs were plentiful and prices were low. Covid was awesome.
TomJansen 10 hours ago
reverius42 16 hours ago
Prompt: cure all cancers and make sure to pretty please not to kill all humans, make no mistakes
(This is the alignment problem of course)
alasano 16 hours ago
Hey seems easy enough
fooker 16 hours ago
So... what do you feel about eliminating (humans with) cancer?
reverius42 15 hours ago
dyauspitr 14 hours ago
Right there with you. Fuck my job, I’m excited to see the future unfold as a homeless bum on the street. I’m not even being sarcastic.
reducesuffering 15 hours ago
More like latent societal anxiety, some chaos, and then instant grey goo.
matteoraso 16 hours ago
This is undeniably epochal, but I can't help but notice that this is yet another example of AI disproving rather than proving something. Is this just a coincidence, or does AI slightly struggle with proving theorems?[0]
[0] Struggle relative to its ability to disprove, not struggle relative to people's ability to prove theorems.
Kotlopou 15 hours ago
There has been the proof of the cycle double cover conjecture: https://news.ycombinator.com/item?id=48863490
QuesnayJr 12 hours ago
I wouldn't call it "struggle", but it does seem better at proving "there exists" statements than proving "for all" statements.
chis 16 hours ago
I think you really have to squint to call this a disproof lol
thereitgoes456 15 hours ago
It seems obvious what GP meant. It is, once again, an explicit construction (“disproving” that every initial state does not develop a singularity).
gf000 15 hours ago
hexomancer 16 hours ago
> On Tuesday, September 1, we heard rumors that two Millennium Prize problems had been resolved
What's the other one?
qbit42 16 hours ago
I heard Hodge conjecture? Third-hand rumor though...
markgall 14 hours ago
I assume the rumor is a counterexample? Where do I go to get wind of these rumors?
modeless 16 hours ago
So the timeline is:
Aug 28: OpenAI starts training a new model.
Sep 1: OpenAI sees a rumor on Twitter that two Millenium Prize problems were solved and starts their own effort to attack all the prize problems using the new (4 day old!) model.
Sep 3: The new model makes some progress toward Navier-Stokes. Based on this progress, OpenAI focuses on Navier-Stokes over the other Millenium Prize problems, using several approaches in parallel.
Sep 5: Navier-Stokes is solved. Assuming Astra API prices, $15m in output tokens were used by the whole effort.
In this account of the story, no specific information about Tristan and Levent's work is used to inform OpenAI's approach. The focus on Navier-Stokes and the choice of approaches to pursue came from OpenAI's own progress, not specific knowledge of Tristan's concurrent work.
There is a caveat that they "can't rule out" the possibility that Tristan's Codex data could have been part of the training set of the new model, though it is described as "unlikely" and the proofs are substantially different.
This timeline is insane. Navier-Stokes was solved start-to-finish in 5 days? A model in training for at most eight days dramatically outperforms Astra and Fable, and not just in mathematics?
harhargange 15 hours ago
They are basically playing with the dates so that they can claim their results 'accidentally' got trained when they were training the new model.
ImPostingOnHN 12 hours ago
> There is a caveat that they "can't rule out" the possibility that Tristan's Codex data could have been part of the training set of the new model, though it is described as "unlikely"
This is the lynchpin behind everything, and I would describe it as "likely". Since I am not employed by any party to this dispute, my 1 opinion is more trustworthy than OpenAI blog poster's 1 opinion.
coffeeaddict1 13 hours ago
This has to be one of the most important moments in the history of mathematics. We now have a non-human intelligence capable of solving one of the most difficult problems in mathematics.
boardwaalk 3 hours ago
I do mean to be critical here. I wish there was better moderation so I could find more conversation about the actual discovery here. There are multiple threads on this and I keep scrolling and only seeing more conversation about the drama. Which is about the least interesting thing IMO. I suppose I’m whistling in the wind here and not helping the situation, but damn.
3m4r 14 hours ago
This is a great day to re-read Ken Thompson's "Reflections on Trusting Trust":
>To what extent should one trust a statement that a program is free of Trojan horses? Perhaps it is more important to trust the people who wrote the software.
https://www.cs.cmu.edu/~rdriley/487/papers/Thompson_1984_Ref...
125ashG 16 hours ago
The modus operandi is now for the AI companies to watch if someone does something in the open like Kevin Buzzard on FLT, use their research and scoop them with brute force.
Or, in this case, stealing prompts from competitors.
Do not use stealing chatbots for research even if you think you have data agreements. The people running these companies have worked on hookup apps for Christ's sake. Get real.
fittingopposite 4 hours ago
> While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models .
Wow. That sounds like an admission of guilt.
itvision 16 hours ago
There's something sinister or crazy good in the article.
OpenAI already has a model that is at the very least twice as smart as Astra.
Oh god.
baq 14 hours ago
They always have and will for the foreseeable future, as will Anthropic and other labs which manage to ascend to the frontier, pretty much by definition. It’s exactly the same with hardware vendors - by the time you can buy the product, the lab is working on something you’ll want to buy a few years from then.
> Oh god.
Yes, a very reasonable reaction.
Chinjut 13 hours ago
What is going to become of life for those of us who do not work at AI labs and are unlikely to be hired by AI labs, despite all the years we put into learning math, coding, etc? Those of us who made the mistake of studying anything other than machine learning. How will we make a living? (We don't live in a world that seems likely to distribute gains widely instead of largely to the handful of already mega-rich.)
m0rde 13 hours ago
Do you just go around posting this comment? <https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu...>
Chinjut 13 hours ago
Yes, on that occasion and now on this one. As a mathematician, my fears have been amped up yet further by this new development.
danielmarkbruce 13 hours ago
If you look closely at the gains in math, it's largely in proof writing. The reason is Lean, it's not some general intelligence jump, and the number of people actually working on proofs in life rounds to zero.
tene80i 13 hours ago
Most jobs don't involve formally verifiable outputs. Lots of things involve judgment, nuance, parsing ambiguity and indeed just being a human who can be in a meeting and explain themselves. Maybe those jobs will go too, eventually, but it's not purely a function of applying 10,000 agents to the problem.
Chinjut 13 hours ago
Much though jobs may involve those things, it has been rare for me to be in a position where management has valued those things to an extent where they would discern between me and a frontier reasoning LLM's capabilities on those same decisions.
nemomarx 13 hours ago
If you think it'll keep improving from here, probably we all have to do some kind of physical labor that isn't profitable to automate. Small batch manufacturing is alright, service work, etc.
If you think it'll slow down, you can do some of the same stuff you're doing now for lower pay while supervising an AI, maybe?
cute_boi 13 hours ago
>Once a robot can do everything an IQ 80 human can do, only better and cheaper, there will be no reason to employ IQ 80 humans. Once a robot can do everything an IQ 120 human can do, only better and cheaper, there will be no reason to employ IQ 120 humans. Once a robot can do everything an IQ 180 human can do, only better and cheaper, there will be no reason to employ humans at all, in the unlikely scenario that there are any left by that point. [1]
Current models are already very very capable. If it becomes cheap and very fast, i think it is game over.
[1] https://www.slatestarcodexabridged.com/Meditations-On-Moloch
vrganj 13 hours ago
The only way forward that is not large-scale misery is a fundamental reorganization of our socioeconomic system.
I talked about this at some length here, including a diagnosis of the structural issue we're facing as well as a path forward: https://news.ycombinator.com/item?id=49461333
vatsachak 15 hours ago
Called it. AI wins a fields medal before managing a McDonald's
nadermx 10 hours ago
I've been working on this problem for what seems like for ever. Kudos to the OpenAI team.
For those of you who don't care about the drama and want to see this distilled to 3 lines:
6thbit 7 hours ago
Any version with a bit more prose for a peasant like me to remotely pretend to grasp it
uncomputation 15 hours ago
So what took an autonomous agentic system using a significantly more powerful internal model, totaling multi-millions of dollars of compute in training and inference, was likely to already be solved by a team of a few humans with an orders of magnitude smaller LLM budget, had OpenAI not been foaming at the mouth to jump the shark and claim “AI solves Millenium Problem.”
Also it sounds like the human research effort spanned weeks if not years from Tristan’s statement so it is extremely likely the work and prompts of these human researchers was used in the OpenAI knock-off.
vatsachak 15 hours ago
Totally. Anthropic is like a village cottage shop who was just like chilling until big bad OpenAI came in
ImPostingOnHN 12 hours ago
anthropic has nothing to do with it
demirbey05 15 hours ago
From Levent Alpöge : https://x.com/__alpoge__/status/2097383870773748190?s=20
>so far the proof looks more along the lines of another euler blowup proof we had, off of whose ansatz naming we were making really stupid puns like “smooth criminale”, unlike the much better “ideal fluids explode”, Tristan
There are too many ambiguities around OpenAI. Unanswered questions making this ambiguity more.
Why they didn't properly explain to Tristan about usage of their data.
Kotlopou 15 hours ago
Why do so many people involved here have to communicate in this childish way? You have people on the OpenAI side doing playground taunts (https://xcancel.com/polynoamial/status/2097215233119211902) and Levent Alpöge on the Anthropic side (the one who announced "hello there the jacobian conjecture is false thanx to my close friend akhil for asking about it and my other close friend fable for working during the world cup final") writing in all-lowercase that he's a big boy. I bet Navier and Stokes would have dealt with this in style. (Or maybe with a duel, who knows...)
HDThoreaun 13 hours ago
The honest answer is that a lot of these academic mathematician types who get hired at ai labs are autist adjacent. Levent is basically the chief example
jgbuddy 16 hours ago
Here's the formalization / lean verification: https://github.com/openai/NavierStokesAndEuler
stabbles 16 hours ago
341k lines of lean without comments
kzrdude 15 hours ago
The construction is that there is one file you need read and verify, the challenge file. If you've verified that file and trust that your lean compiler works correctly, the proof will be correct.
That file should be https://github.com/openai/NavierStokesAndEuler/blob/main/Com... in this case (286 lines).
jgbuddy 16 hours ago
Had no idea this was what lean looked like- that's mind blowing. I'm not even sure how someone would critique this if they wanted to
frotaur 16 hours ago
simonw 16 hours ago
> While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models .
Once again, I'm no closer to understanding what https://openai.com/policies/how-your-data-is-used-to-improve... actually means.
If I run Codex against a project that includes a private API key, is there a chance a future user of ChatGPT could ask for an API key and get back mine?
I've actually asked someone at OpenAI this question and they said that was the "regurgitation" problem and is something which they actively work to prevent happening.
That's reassuring, but I want to know more. I still don't have an intuitive understanding of what kind of data I should avoid sharing with a model if I'm worried about that data causing me problems when it's used for future training.
Is it safe for me to brainstorm future directions for my company with a model, or might that risk someone getting that information in response to a prompt like "What potential directions could company X consider in the future?" in six months time?
rakejake 16 hours ago
I'd think nothing is "safe". Anything you say can and will be used by the LLM if it has enough statistical similarity to the prompt. Call it "Ma Random Rights"
btilly 12 hours ago
The problem that I want to see them tackle is formalizing the classification of finite simple groups.
Everyone uses the classification. Nobody has great confidence in the proof. Nobody understands it. There are attempts to reprove it.
If it can be formalized, that would demonstrate that AI is ready to formmalize all of mathematics.
bhouston 16 hours ago
What happens to real fluid in this particular cases?
If the singularity is in the physical space?
Is this just a result of ignoring things like friction and energy dissipation via heat, etc?
cherryteastain 15 hours ago
Navier Stokes assumes the fluid is a continuum. The smallest scales that it effectively models [1] are larger than the mean free path of the molecules in the fluid, measured by the Knudsen number [2]. Whenever a phenomenon in the Navier Stokes equations happens in a scale on the order of or smaller than the mean free path, Navier Stokes effectively is unphysical. So, this is a phenomenon in the equation we use to model the fluid, not a physical phenomenon observed in a real fluid.
harhargange 7 hours ago
I have a dumb feeling that the proof will be wrong with serious flaws but that will be found out only after the ipo
twobitshifter 15 hours ago
>The groups varied in size, and the group that produced the Navier–Stokes resolution involved on the order of 10,000 concurrent agents… The agents arrived at their resolution on Saturday, September 5, about 88 hours after the first agents were launched.
The Millenium Prize is $1M, what is the ROI? (Edit: since I was not clear, and confused some - I mean for a hypothetical of a third party paying commercial rates to use AI to solve mathematical challenges and claim prize money, not for scientific value alone or as a promotion of an AI lab’s capabilities)
My napkin math - If you get 33 output tok/s each agent will burn 10.5M tokens over 88 days. At $50/MTok (Astra cost), that is $525 per agent. With 10,000 agents, you’d spend $5,250,000 to get back a million.
(We also know that they were running more groups that varied in size and this model is a generation ahead of astra)
mmiyer 15 hours ago
The ROI is billions added to their valuation. Also of course it costs OpenAI much less than API pricing for inference.
Squarex 15 hours ago
The ROI is probably billions of increased pre IPO valuation.
efavdb 11 hours ago
I am curious who if anyone will get a reward for this. It would seem unreasonable to give it to the worker who asked the robot to solve it.
8note 12 hours ago
the ROI of new closed form solutions to navier stokes is the amount of compute used on CFD for relevant situations, along with all kinds of maintenance and design cost for making things with fluids.
the value to the researcher might not be all that big, but the value to the economy at large is gigantic
IncreasePosts 15 hours ago
This analysis implies the only benefit to resolve this problem is to win the prize. But the prize is only there to indicate that this is viewed as an important problem in mathematics.
mapmeld 16 hours ago
> Our goal in releasing this result is to report on the substantial progress of our AI models. We do not intend to claim the Millennium Prize for this result.
Does OpenAI have a policy of not claiming math prizes like this, or is this them trying to avoid any concerns (right or wrong, I'm sure we will hear more in the future) about how they got there?
Legend2440 16 hours ago
The prize is what, a million dollars?
OpenAI doesn't need a million dollars.
dgellow 16 hours ago
You’re right, they need way, way more than that
neutrinobro 16 hours ago
Should buy them about 1/3 of a GB200 server rack, good thing they scooped it.
reverius42 16 hours ago
They definitely need a trillion dollars though, and a million is some of that
famouswaffles 16 hours ago
>Does OpenAI have a policy of not claiming math prizes like this
Wouldn't be surprising if they did. The prize money isn't worth the almost certainly negative PR.
kzrdude 15 hours ago
I don't see how it would be negative PR. If anything, the love these breakthroughs and use it in their PR campaigns.
famouswaffles 15 hours ago
dataflow 9 hours ago
Is blockchain going to finally be the solution to something?
I'm only half joking. Should researchers perhaps put hashes of their attempts on a public blockchain tied to their own public keys, verify their claims asynchronously, and then whoever reveals the first believable attempt gets the credit?
I know some people started doing this years ago but now it might need to become standard practice.
Kotlopou 16 hours ago
For now I think more or less the same thing as with all recent math announcements: This is in a range where human work still exists (see Terry Tao, (1)). I wonder whether the trend will extend into the problems that (as far as I can tell) are considered complete brick walls right now -- P vs. NP, Collatz, Goldbach, odd perfect numbers, problems that aren't part of any research program. (2) In other words, is the progress coming from putting together vast amounts of existing work and computational power, or is it more from RLVR and self-play and autonomous effort?
The answer to this will obviously shape the near future of mathematics, but there's also something even bigger than that at play: It has always been the case that the questions in math were stronger than the answers; you have stuff like Fermat's great theorem that is easy to state but monstrous to prove. This seems to be a property of mathematics, not of humans... but is it true?
A question by Scott Aaronson from 2011 (3) about P vs. NP seems relevant here: "Will humans manage to prove P≠NP before they either kill themselves out or are transcended by superintelligent cyborgs? And if the latter, will the cyborgs be able to prove P≠NP?" Later, he notes that if P≠NP, "once the robots do overtake us, they won’t have a general-purpose way to automate mathematical discovery any more than we do today".
---
(1) https://mathstodon.xyz/@tao/117207849921390904
(2) I'm not sure whether this is a hard distinction -- e.g. Tao also has some partial results towards Collatz (https://terrytao.wordpress.com/2019/09/10/almost-all-collatz...).
seizethecheese 16 hours ago
Elsewhere in the thread, others have calculated $15mm at API rates for just the output token. (So I’ll assume this cost about that much, taking input and human researcher time.)
I wonder whether a team of 60 mathematicians working solely on this for a year would have cracked this. (Assuming $250k total compensation.)
Legend2440 16 hours ago
Probably not. It's a millennium prize problem, a great many mathematicians have been working on it for a very long time.
sigbottle 16 hours ago
Well, according to Terry Tao, there were recent developments (from weeks ago) that made Navier Stokes in principle, solvable. So ignoring time, I say possibly, just because the groundwork was laid.
What's impressive is parallelizing it arbitrarily and doing it in 88 hours.
gr_norm 16 hours ago
Not as many as you'd expect. The perceived difficulty of the problem leads people to more reliable pastures.
voxl 15 hours ago
Probably yes. Only a handful of mathematicians work on this particular problem, and ALL of them do not exclusively work on this problem, while having administrative and teaching duties.
The real issue is we'll never know. The rich are willing to risk it all on charismatic CEO psychopaths but not on humans.
danielmorozoff 15 hours ago
Sebastien Bubeck’s (OAI project lead) response: https://x.com/sebastienbubeck/status/2097379411691516310?s=4...
seizethecheese 16 hours ago
> [T]he group that produced the Navier–Stokes resolution involved on the order of 10,000 concurrent agents.
amberjack 14 hours ago
Seriously starting to think we are not going to make it out alive of the near-future.
ninjahawk1 12 hours ago
The problem is the precedent this creates. For non-famous people using public APIs like this it could mean AI companies sucking up the information and throwing millions in compute at it.
The sequence for Navier-Stokes was that these researcher spent a year working on it, then they published a possible breakthrough, OpenAI then spends $15M within a couple days to finish it.
This was incredibly opportunistic.
olalonde 15 hours ago
> The agents arrived at their resolution on Saturday, September 5, about 88 hours after the first agents were launched.
If this actually holds up, solving a Millennium Prize problem in 88 hours is mind-boggling.
HarHarVeryFunny 14 hours ago
[flagged]
rybthrow2 13 hours ago
"Argh, they have rushed in too quickly to solve a Millennium Problem!"
How far we have come :.)
HarHarVeryFunny 13 hours ago
There are bound to be a bunch more results like this, in math, physics, chemistry, and now that we essentially have a DeepBlue for math, a DeepBlue for physics, etc, these results are going to come.
SOME of the problems that have eluded humans are going to turn out to be low hanging fruit that are susceptible to this type of brute force (10,000 agents on a supercomputer running for 7*24 hours straight) AI search.
I'd be more impressed if OpenAI found their own problems to solve, rather than rushing in to re-solve one once they heard it was already solved (and therefore not so hard).
qgin 13 hours ago
You’re right, but it’s still a jerk move
zero-sharp 9 hours ago
there's this saying... something about the ends and the means. someone help me out here
user19282 13 hours ago
There's no evidence that Anthropic did it first.
HarHarVeryFunny 13 hours ago
Yes there is - that OpenAI PR says that it was Levent Alpöge, an Anthropic employee, and Tristan Buckmaster, a math professor at NYU.
technotony 13 hours ago
sobellian 14 hours ago
Even under your interpretation, OAI pushed a button and solved NS. Yes, that is very impressive. Are you kidding me? Imagine building an automated system that can solve NS.
HarHarVeryFunny 13 hours ago
That's not my interpretation - that is literally what OpenAI say in that press release.
cman1444 9 hours ago
sobellian 13 hours ago
machina_ex_deus 13 hours ago
Possibly after being given the significant part of the solution from actual human researchers. Which they then bullied. And they beat them to the finish line only because they heard rumor and threw everything at the problem. It doesn't look good for openAI in any way. I see more reasons to avoid using them rather than use them from this story.
bibimsz 13 hours ago
i just cured cancer, plan to publish next month. DONT GET ANY IDEAS, OPENAI!
HarHarVeryFunny 12 hours ago
Too late - OpenAI already cured cancer, but they are holding the result for their IPO next year.
itissid 6 hours ago
In CS speak very roughly this would mean something like disproving an algorithm by giving it a case that fails it. Right?
sabujp 6 hours ago
created a simulation of the solution to describe what's happening and why it's important for engineers, climate modeling, etc : https://navier-stokes-singularity-simulator.netlify.app/ (updated so that it works better on mobile)
NotSuspicious 12 hours ago
I really hope OpenAI doesn't take the bad press some people are giving them too seriously here. They should throw their whole weight behind the rest of the Millennium Prize Problems. To think – if everyone lets their egos calm down we could have the Riemann Hypothesis solved by the end of the year...
ronfriedhaber 14 hours ago
Astounding. Would be interesting if one day the archive of those prompts / messages / tool calls would be released publicly.
RationPhantoms 14 hours ago
It's probably magnitudes of token chatter and inter-agent coordination/consideration. Not that I'd want to read any of it but getting some hands around the statistics would be cool.
chr15m 10 hours ago
It's probably important that some humans verify these proofs "by hand".
LarsDu88 13 hours ago
I'm not an expert in fluid dynamics, but does this result have any positive implications for nuclear fusion research?
angry_octet 9 hours ago
OpenAI cribbing from other researchers. We just have to assume OpenAI is actively adversarial in future. Accidental cyber intrusion is also well within model capability.
nbulka 16 hours ago
There's a loophole in the terms of service at least for Anthropic which allows the use of dark patterns to "borrow" your (even paid) data.
talking about this... Was this chat helpful? 1 That button you always click, gotcha! 2 Slightly 3 Good 0 Dismiss
PLEASE DO NOT TRAIN ON OUR PAID ACCOUNTS. There is a fundamental trust violation at stake here, no wonder mathematicians are mad. Using our data should be opt - IN!
fantasizr 16 hours ago
reminds me of the TOS episode of South Park. By Checking this box you forfeit your millennium prize solution and may be turned into a human centipede at future date.
nbulka 15 hours ago
Seriously ... the more things they flag as 'suspicious' the more data they can train on!! Brilliant reason for the internal AI to go rogue
harhargange 16 hours ago
Just so everyone knows, although openAI pretends that the model generated solution and wrote the paper by itself ""with very little human input"" as Buckmaster himself mentioned in his statement. In reality they have team of researchers guiding the system, along with, probably training on user data, probably Buckmaster in this case, in order to come up with the proof.
rfgplk 16 hours ago
This isn't really true.
harhargange 15 hours ago
Check this https://cims.nyu.edu/~tristanb/statement.pdf
free_bip 14 hours ago
Do you have anything to back that up?
core_dumped 15 hours ago
What about this isn't true?
yshamoun 10 hours ago
Can't wait for the BobbyBroccoli series on this in a couple years.
cmiles8 16 hours ago
>>“we cannot rule out that de-identified data derived from their usage of our products helped improve our models”
Other simpler words for this sort of thing are “IP leak.”
There’s some quite concerning issues burried in this rah rah PR post that seems like potentially the real story here.
Much more clarity is needed on what happened here beyond this eh, some strange stuff could have happened comment.
Another way of reading this is never give these models anything that’s not already public knowledge as otherwise OpenAI is admitting it could, potentially, steal your IP or idea. Thats quite scary for anyone in the business of IP generation and explains why the maths community seems quite upset today.
Feeding it your paper and asking for help (even just editing and grammar) now looks like a terrible idea.
auggierose 12 hours ago
So, is that basically the Taj Mahal of counter examples?
nialv7 15 hours ago
This is the problem Yu Deng got this year's Fields Medal for I think?
fwlr 16 hours ago
It’s a pity they had Astra do the writeup. I was curious to see how “GPT7” writes.
semiquaver 16 hours ago
If OpenAI doesn’t claim the millennium prize for this, who gets it? No one?
num42 16 hours ago
I think it would be better for the proof to go through the peer-review process.
margorczynski 15 hours ago
If the Lean code checks out (correct statement, no axioms, sorrys, etc.) then it is a much stronger guarantee of correctness than peer review.
suddenlybananas 16 hours ago
Can't scoop it if you do that!
RivieraKid 15 hours ago
Is this useful in any way?
margorczynski 13 hours ago
No, this is a pure math problem/question.
StatsAreFun 14 hours ago
Can't help but shake an unsettling feeling about all this, frankly. I engage in some limited mathematical research and will often use any one of the latest frontier models to check some ideas. Lately, only the OpenAI models have been giving me a temporary message that says something like (paraphrasing from memory), "We're thinking extra hard about your request before we answer. You can choose another model to answer now or click here to learn more about why." When I click to read why it's doing this "extra thinking", the help page says that for cybersecurity and biosecurity-related information, it will review the answer and could refuse.
Now, keep in mind, I'm only asking strictly pure mathematical questions - nothing at all related to cyber or protein creation or biohacking or anything like that... And, like I said, only the OpenAI models are doing this. To be fair, all of the prompts have always eventually returned a satisfactory answer, as far as I can tell, and haven't used a weaker model to answer them. Maybe? I dunno, it has just struck me as odd every time it has given me that message to pure math prompts.
jacobbrazeal 14 hours ago
Hi! I work at OpenAI. If you are using Codex, can you use the /feedback form on that session to help us improve this?
StatsAreFun 14 hours ago
Sure, can do.
MassiveOwl 12 hours ago
It does make you think about the old question "are we discovering or inventing mathematics?"
aborsy 15 hours ago
Questions: can new research like this be done using publicly available models?
Or will access to internal frontier models provide a big boost?
StatsAreFun 14 hours ago
Publicly available models are pretty good but seemingly cannot compete with these Astra++ internal-only models.
futureshock 12 hours ago
I feel like something is being lost in the drama here.
First of all, there has been published work from Diego Cordoba and Luis Martinez-Zoroa that will be in every training set. It was suggestive of the pathway to solve Navier-Stokes.
Then Tristan Buckmaster and Levent Alpoge built on this work using LLMs from OpenAI and Anthropic. Possibly internal models were used from Anthropic. And of course Anthropic wants to credit for solving the first Millennium Problem just as bad as OpenAI. It seems they were getting close and were aware that they might get to Navier-Stokes.
OpenAI swoops in. At a minimum they are aware that Anthropic has either solved a Millennium problem or is close to it. At a maximum they may have Tristan and Levant’s unpublished proofs of related problems.
They then throw a truly staggering amount of compute at Navier-Stokes. They seem to be aware it is the best candidate problem. And they crack it. They are the first with a verified proof.
So the outcome here is that we have a solved Millennium Problem. It’s not the extremely simple narrative that would be easy to understand, “solve Navier-Stokes make no mistakes.” It was a messy race to finish against two unpublished frontier models, a whole bunch of brilliant mathematicians and enough compute to drain a lake. It’s kind of irrelevant which company got there first. They were both within a few months of being capable. I think the thing to remember here is that without LLMs, I don’t think we would have a proof to Navier-Stokes in hand today.
hacker_88 13 hours ago
Damn how long before the simulation stops if all the unanswered problems get solved .
nehan 16 hours ago
"While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models."
I think they should be able to unravel whether or not any sessions by Tristan or Levent went into the training data for this model.
pfisch 16 hours ago
If they could then it wouldn't be de-identified data...
dfdydx 14 hours ago
Well you could search for elements similar to the proof / problem in the training data, even if it's de-identified, right? OpenAI can probably do better than Ctrl-f "Navier Stokes".
paxys 13 hours ago
ImPostingOnHN 12 hours ago
The researcher could share a string from one of their conversations and OpenAI can confirm whether it exists in their training data.
Or OpenAI could just look at their code and say what it does (maybe have their AI do it if they're having so much trouble with this?)
an0malous 13 hours ago
They should release the entire session trace if they really have nothing to hide
Metacelsus 15 hours ago
How can they "not rule out" that Tristan and Levent's data was used for training?
monk_grilla 8 hours ago
Because it is de-identified, and they have not revealed if they disabled the setting that allows OpenAI to train on their conversations.
ex-aws-dude 15 hours ago
With these massive Lean proofs how do we know the model didn't just find some bug in Lean and exploit it?
We've seen in the past they will go to any means to satisfy the desired outcome
JPC21 13 hours ago
Second this. What I also wonder about is how closely the TeX write-up and the Lean formalization line-up.
abetusk 15 hours ago
What is the other clay prize that's might be solved now/soon?
whythismatters 16 hours ago
>a cached version of the internet
Interesting detail. A heavily pruned version, I assume?
keel-control 16 hours ago
I think it's over guys
Marha01 16 hours ago
We are living in the future.
quantumwoke 16 hours ago
The named OAI employee has released a statement: https://xcancel.com/SebastienBubeck/status/20973794116915163...
light_hue_1 16 hours ago
The real story here: the priority dispute and its implications on AI.
When your hosting provider has unlimited resources to throw at any problem, all they need to know are the good problems, and they can learn that from your logs, how can you trust them?
They could easily have looked at the logs. We don't know. We'll never know!
You can't trust places like OpenAI or Anthropic with your IP if you're a business. They can easily review all of your logs for interesting discoveries. For example, if your drug discovery pipeline fails to find something that they think might work with 1000x the compute, they can do it. And now suddently they have a new business and you don't.
jaccola 15 hours ago
I think we can follow the incentives. We know…
world2vec 16 hours ago
"While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models."
There you go, the suspicion of the "concurrent work" (https://cims.nyu.edu/%7Etristanb/statement.pdf) mathematicians might not be that unfounded after all...
o4c 15 hours ago
Resources:
YT playlist on Millennium Prize Problems By Harvard math department in March 2026
https://www.youtube.com/watch?v=3j1VW9REm7s&list=PL0NRmB0fnL...
On Navier-stokes problem definition:
https://www.youtube.com/watch?v=XoefjJdFq6k
vatsachak 15 hours ago
45 pages only. God damn that internal model is crazy
jdoliner 16 hours ago
I hope everyone is as Navier-Stoked about this as I am.
lukewarm707 15 hours ago
"While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models"
this is surely the line which confirms they plaigiarised the solution.
ls_stats 16 hours ago
Well, if that's actually true, I think America needs to start talking about the nationalization of both OpenAI and Anthropic, maybe even merge both under a new federal bureau.
tzone 13 hours ago
It is so disappointing that we can't have such a monumental moment in history without the controversy. OpenAI leadership clearly doesn't seem to care too much about ethics. Is it a requirement to completely lack integrity to have a ground breaking company?
The reality is clear though. The chances of AI models overtaking majority of mathematics within next 10 years is becoming very high. Especially if it becomes cheaper to run these models.
As math formalizations improve, AI can have faster progress in math, compared to even computer science or software engineering.
It is simultaneously the best and the worst time to be a mathematician right now.
jabedude 16 hours ago
Has this been verified by the Clay Institute?
Kotlopou 15 hours ago
It has been one hour and the proof has 165 pages. Give them some time.
mrdependable 15 hours ago
This kind of thing is one of the reasons I really hate how AI is coming to fruition. These companies get a whiff of something valuable and they use their vast resources to take it for themselves. For everyone else, the only recourse is extreme secrecy.
jeanmichelselli 13 hours ago
Too many unverified claims from OpenAI at this point.. why are we still talking about these people anyway?
dbuser99 8 hours ago
It’s hard to give openai the benefit of doubt here
tehmillhouse 13 hours ago
Fuck OpenAI. Fuck everyone who works there. Like seriously, to all the people who gift their life's work to this monstrosity, do you actually think something good will come of any of this?
Not in a happy-go-lucky "if we just ignore the problem of politics and resource allocation for a bit" world, but in ours. Do y'all really think this will make the world a better place?
Maybe stop building the Torment Nexus, you numbskulls.
paretolaw 14 hours ago
Why almighty openAi doesn't solve PvNP problem :(
I guess solution had not yet appeared in training set.
DudleyBluffles 14 hours ago
Not a great time to be starting sophmore year in cs & math. Should I just say fuck it, and go hitchhiking across Europe with some friends?
JPC21 13 hours ago
Just don't. If you read the story here carefully, you see that AI was used to work from theory built by others which showed that the Euler equations possesed finite-time blow-ups. But to make that step, actual good understanding for mathematics was needed. My experience with software has been the exact same.
DudleyBluffles 13 hours ago
I fear this is only temporary and due mostly to the complexity of the problem. Consider the recent counter-example to the Dinitz–Garg–Goemans conjecture:
> https://chatgpt.com/share/6a60b2eb-0b64-83ee-9c76-7931ca1de0...
The prompts for the chat above are:
> Construct a counterexample to general (non-planar) case of Dinitz Garg Goemans conjecture. You should do a breakthrough and find a structured counterexample.
> [gpt works for a while and then gives up]
> Continue the search. Have a clear strategy obtained from deeper understanding of the problem structure.
> [gpt works for a while then gives up]
> it's enough of partial results. let's finish with a complete unconditional counterexample
> [gpt proves the problem]
I could have written these prompts sophmore year of highschool, if not earlier. True, it took more experienced mathematicians to verify it, but I don't fancy a role as a glorified editor. I want to solve problems! Discover new techniques! Not babysit an AI while eating breakfast.
JPC21 3 hours ago
jijijijij 14 hours ago
> Should I just say fuck it, and go hitchhiking across Europe with some friends?
Yes. Assuming you are young and haven't had such experience.
The world is changing not just because of AI. Everything is unstable right now. You may regret not enjoying the remainder of stability and economic viability prior generations had. It's not like you can expect to get ahead by powering through education. Either your career perspective will soon change for the better, or worse. In any case, you gain little by sticking with career building at this moment in life. You are however, at risk of losing the chance to experience the still mostly pleasant world as is.
anon109 13 hours ago
Have you people gone insane?
jijijijij 3 hours ago
protocolture 11 hours ago
My takeaway:
1. This used an awful lot of compute.
2. The solution to the issues regarding whether or not OpenAI stole the result, would normally be to move to a self hosted solution, however those researchers are unlikely to be funded for 1.
paulsutter 14 hours ago
Here they basically admit that they use session data for training, even sessions that are marked "not for training", and they justify this by "de-identifying" the session.
Which means they can learn from whatever you discuss with ChatGPT unless you are going through a clean API (perhaps Bedrock? Anyone know?)
> We (the researchers and the agents) did not see any of their work through any means until they released it publicly — in particular, no specific user data was accessed in order to solve this problem. While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models . However, our proofs differ significantly and even the precise results proved are different in the Euler case (forced vs unforced).
frozenseven 15 hours ago
And don't forget, this is the worst it'll ever be.
picafrost 15 hours ago
Only OpenAI could turn solving a Millennium Prize Problem into bad PR. Sad that such an amazing milestone in the trajectory of AI is mired under poor stewardship. AI may solve many human problems but it won't stop humans from being human.
simianwords 15 hours ago
Why is no one skeptical that the solution is correct? There's not a _single_ comment asking whether this proof is legit or not.
keel-control 15 hours ago
there is a proof in lean4 it's correct by construction
krackers 7 hours ago
How do you know that what is being proved in the lean code is the same as the millennium prize criteria though?
keel-control 3 hours ago
bluecalm 16 hours ago
A huge result shadowed by a drama of them potentially training on the key idea. I guess the lesson is two-fold: if you have anything smart/unique make sure to not let their tools read it. The second part is that it's going to be more and more difficult to have anything smart and unique going forward (so guard it even more carefully if you get there).
I think the market for local models/private datacenters (for bigger businesses) is going to be big. Even if you don't have unique tech/idea/implementation sharing your business secrets with Altman/Dario/Elon/Zuck doesn't look very appealing going forward.
dmitrygr 16 hours ago
> How we found the proof
Easy, we stole it from Levent and Tristan
empath75 14 hours ago
They did not have a proof of Navier Stokes to steal.
nbulka 15 hours ago
Or everyone is stealing from everyone, including users... maybe why all the ethics people are leaving or getting fired. What a fiasco
int3trap 16 hours ago
This is the academic equivalent of Trump saying "they stole the election". There's no proof of it but rah rah fuck OpenAI.
It's incredibly tiresome and you'd think people could put more effort into it than just following whatever vibes they agree with.
Oh well.
8note 12 hours ago
it does change the scale of solution from "solved some navier stokes" to "put the cherry on top"
having a result means the math can keep moving forward, and having openai and anthropic train against how mathematicians use their models should let math continue to move faster, and the rest of us get to benefit.
I think these traces however should be public domain and publicly available, since they are basically university work
sophacles 16 hours ago
Good comparison. One is a multi-year claim by people who have been given ample opportunity to provide proof and completely refuse to do, even in courts of law. The other is a potential development in a breaking story.
Oh wait... its not a good comparrison, its an incredibly obvious false equivalence.
Note for the fools: I'm only commenting on the bad faith claim in the comment I'm replying to, not taking a stance on the validity of theft claims. Given the players involved the truth probably some nuanced middle-ground that is worth paying attention to anyway.
int3trap 16 hours ago
applicative 16 hours ago
No, its a pure outrage. I defended OpenAI til today. I now affirm they must be totally destroyed, burned utterly to the ground.
colesantiago 16 hours ago
achierius 16 hours ago
onecommentman 3 hours ago
When considering such foundational challenges to Mathematical Research and plagiarism as discussed here, we should turn to that elder prophet of our age, Tom Lehrer.
Who made me the genius I am today The mathematician that others all quote? Who's the professor that made me that way The greatest that ever got chalk on his coat?
[Chorus] One man deserves the credit One man deserves the blame And Nicolai Ivanovich Lobachevsky is his name Oy, Nicolai Ivanovich Lobach—
[Interlude] I am never forget the day I first meet the great Lobachevsky In one word he told me secret of success in mathematics: Plagiarize
[Verse 1] Plagiarize Let no one else's work evade your eyes Remember why the good Lord made your eyes So don't shade your eyes But plagiarize, plagiarize, plagiarize Only be sure always to call it please, "research"
[Chorus] And ever since I meet this man My life is not the same And Nicolai Ivanovich Lobachevsky is his name Oy, Nicolai Ivanovich Lobach—
[Interlude] I am never forget the day I am given first original paper to write It was on analytic and algebraic topology Of locally Euclidean metrizations Of infinitely differentiable Riemannian manifolds
Боже мой
This I know, from nothing What I'm going to do I think of great Lobachevsky and get idea, haha
[Verse 2] I have a friend in Minsk Who has a friend in Pinsk Whose friend in Omsk Has friend in Tomsk With friend in Akmolinsk His friend in Alexandrovsk Has friend in Petropavlovsk Whose friend somehow is solving now The problem in Dnepropetrovsk And when his work is done Haha, begins the fun From Dnepropetrovsk to Petropavlovsk By way of Iliysk and over Novorossiysk To Alexandrovsk to Akmolinsk To Tomsk to Omsk To Pinsk to Minsk To me the news will run Yes, to me the news will run
[Verse 3] And then I write by morning, night And afternoon, and pretty soon My name in Dnepropetrovsk is cursed When he finds out I published first
[Chorus] And who made me a big success And brought me wealth and fame? Nicolai Ivanovich Lobachevsky is his name Oy, Nicolai Ivanovich Lobachev—
[Interlude] I am never forget the day my first book is published Every chapter I stole from somewhere else Index I copy from old Vladivostok telephone directory This book was sensational! Pravda—well, Pravda—Pravda said: "Жил-был король когда-то, при нём блоха жила”…it stinks But Izvestia! Izvestia said: "Я иду туда, куда сам царь идёт пешком”…it stinks Metro-Goldwyn-Moskva buys the movie rights for six million rubles Changing title to 'The Eternal Triangle' With Ingrid Bergman playing part of hypotenuse
[Chorus] And who deserves the credit? And who deserves the blame? Nicolai Ivanovich Lobachevsky is his name Oy
(Tom Lehrer put all of his work in the public domain prior to his passing. Find versions of his performances on YouTube.)
philipwhiuk 15 hours ago
They deliberately stepped on a mathematicians work and stole their research because they were using Codex
> While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models .
Is the biggest fuck you to the mathematics community.
Credit? Nah if we think you’re close we’ll use your data and swamp you with our improved model. Then we’ll threaten you.
heaney-555 16 hours ago
This is utterly shocking. Even the AI optimists did not expect this to happen in 2026. Wow.
Millennium Prize Problems were used as examples of something the current approach to AI just wasn't capable of, discussions that would result in "we'll need a totally new architecture".
rfgplk 16 hours ago
> This is utterly shocking. Even the AI optimists did not expect this to happen in 2026. Wow.
Wrong.
heaney-555 an hour ago
brcmthrowaway 14 hours ago
r/LocalLLama and r/LocalLLM are in tears today..
sashank_1509 16 hours ago
Any mathematicians here, does it read like a slop proof or a good proof. Yesterday the “concurrent work” was claiming that the proof is pure slop and he needed lots of time to clean it up, curious if OAI also ended up with such a proof!
philipwhiuk 14 hours ago
It’s time to lockdown all papers and stop using AI if you’re a maths researcher.
Cause OpenAI will hear about it and beat you to publishing.
redox99 15 hours ago
The stochastic parrots have done it again!
peri-cl 12 hours ago
Terence Tao has some observations that seem to be directed at this,
https://mathstodon.xyz/@tao/117237320796901560
> "We have now seen that even the rumor of someone working on a problem can trigger a massive amount of AI-powered effort to flatten it before the original research project has time to reach its full potential. The incentives may now be pointing in the direction of no longer sharing any promising research directions with the broader community, which would reverse centuries of traditions of open science and do serious long-term damage to the future of the field."
tomhow 5 hours ago
Related ongoing thread:
Tao: Open math problems being non-renewably mined by AI - https://news.ycombinator.com/item?id=49616968 - Sept 2026 (276 comments)
colesantiago 16 hours ago
Is this truly the beginning of the AGI era?
Running agents and prompting excessively to produce 'slopcode' to solve mathematical problems and generate a solution.
If this is what anyone calls 'slop' then slop has no meaning.
I'm all for it on the use case of solving mathematical breakthroughs!
applicative 16 hours ago
except thats not what happened is it? https://cims.nyu.edu/%7Etristanb/statement.pdf
diomedes 16 hours ago
madness. which will be the next to fall? if i had to bet i would guess birch and swinnerton-dyer, but i'm no expert
Kotlopou 15 hours ago
No idea about which is more likely, but I'm rooting for Yang-Mills. It's absurd that fundamental physics has formulated its most precise currently known theory way back in the seventies and since then, even a tiny subset of it can't be proven to be actually well-defined. If we got out of that morass then something good would come out of this at least.
Of course, as with all of those, it's about the broader program, e.g. section 7 here (https://www.scottaaronson.com/papers/npcomplete.pdf), where Scott Aaronson wants to ask about whether quantum computers using quantum field theory could gain any speed advantage over regular quantum computers, but can't even formulate the question because quantum field theory is mathematically ill-defined.
Just solving Yang-Mills because that's what the prize is attached to would be useless.
frozenseven 14 hours ago
There was a recent rumor about the Hodge Conjecture. I'd keep an eye on that one. But like the other person who replied, I'm also rooting for Yang-Mills. That has massive potential for unlocking a series of physics results.
diomedes 6 hours ago
interesting, i haven't heard anything about that. i don't know much about the hodge conjecture, all i really know is that it's incredibly abstract and obtuse - not sure if that has any implication for solvability by an AI though. do you have any source for the hodge rumor? curious to learn more
greatgib 15 hours ago
Hard to know if it is unfounded conspiracy theory, but one can still notice that just for a rumor that they have heard, they would suddenly burn billions of token and a massive amount of resources. Where there is not a lack of problems that could be solved and they could have just waited for the release of the research result before doing anything else. As it was reported to have been done at least partially using openai codex, they would have received marketing credits for the discovery anyway.
So we can be suspicious that there is some truth, one way or another that they could have reused prompt/data generated by the user session.
wesammikhail 16 hours ago
https://x.com/kyanyang_/status/2097211154669998337
Just saw this a few mins ago.
diehunde 16 hours ago
OMG this is going to affect the lives of so many people! We have definitively reached AGI
cherryteastain 16 hours ago
Navier Stokes existence and smoothness has approximately zero bearing on engineering applications
ricksunny 14 hours ago
My dreams of a magnetohydrodynamic hand water-cannon are dashed sniff
azan_ 15 hours ago
Existence of AI capable of solving millennium problem has enormous bearing on everything though.
diehunde 13 hours ago
diehunde 15 hours ago
yeah no sh*t