Mathematical methods and human thought in the age of AI (arxiv.org)

167 points by zaikunzhang 9 hours ago

woolion 6 hours ago

> We assert that artificial intelligence is a natural evolution of human tools developed throughout history to facilitate the creation, organization, and dissemination of ideas, and argue that it is paramount that the development and application of AI remain fundamentally human-centered.

While this is a noble goal, it seems obvious that this isn't how it usually goes. For instance, "free market" is often used as a dogma against companies that are actively harmful to society, as "globalization" might be. An unstoppable force, so any form of opposition is "luddite behavior". Another one is easier transport and remote communication, that generally broke down the social fabric. Or social media wreaking havoc among teen's minds. From there, it's easy to see why the technological system might be seen as an inherent evil. In 1872's Erewhon, Butler already described the technological system as a force that human society could contain as soon as it tolerated it. There are already many companies persecuting their employees for not using AI enough, even when the employee's response is that the quality of its output is not good enough for the work at hand, rather than any ideological reason.

I'm neither optimistic nor pessimistic about the changes that AI might bring, but hoping it to become "human-centered" seems almost as optimistic as hoping for "humane wars".

zitterbewegung 2 hours ago

Not even sure if AI was ever "human-centered" . DARPA funded a large amount of AI reseearch from even the 1960s. The DART tool used in the Gulf War made back all of their previous investments. [1]

[1] https://en.wikipedia.org/wiki/Dynamic_Analysis_and_Replannin...

cowpig 6 hours ago

> "free market" is often used as a dogma against companies that are actively harmful to society

This is a predominantly America-specific piece of propaganda, and it's pretty recent.

Adam Smith's ideas are primarily arguments against mercantilism (e.g. things like using tariffs to wield self-interested state power), something he showed to be against the common good. The "invisible hand" concept is used to show how self-interested action can, under conditions of *competitive markets*, lead to unintentional alignment with the common good.

Obviously that's a significant departure from the way it's commonly used today, where Thiel's book has influenced so many entrepreneurs into believing Monopolies are Good.

But the history of this is very Cold War-influenced, where "free markets" were politically positioned as alternatives to the USSR's "planned economy", and slowly pushed to depart further and further from Adam Smith's original argument about moral philosophy.

abdullahkhalids 5 hours ago

Economic behavior is inherently game theoretic - agents take various actions and get some positive/negative reward as a result. Whether an agent's reward is positive or negative and of what magnitude, depends on the strategies employed by all agents. If some agents adopt new strategies, the reward calculus for everyone involved can completely change [1].

Over the past few centuries, countless new economic structures and strategies have been discovered and practiced. The rewards for the same action today and in the past can be completely different due to this.

So to me, if someone claimed more than a few decades ago that certain economic strategies and structures are good or bad, its simply not worth listening to them, unless someone reconfirms that the old finding still holds with the latest range of strategies. In that case, the credit and citation goes to that new someone, not the ghosts of the past.

[1] A good interactive demo https://ncase.me/trust/

Nevermark 4 hours ago

runarberg 20 minutes ago

slopinthebag an hour ago

The government is a rare example of an extremely strong monopoly and not just a duopoly or a company holding significant marketshare. And yet people never seem to criticise it on those grounds despite it suffering from all of the same problems that corporate monopolies are accused of.

schmidtleonard 5 hours ago

> arguments against mercantilism

It has been funny to watch the rise of "China is beating us" rhetoric against the steady backdrop of "mercantilism is obsolete/bad" dogma, because the elephant in the room is that China has been running a textbook mercantilist playbook.

cowpig 3 hours ago

naasking 4 hours ago

> Thiel's book has influenced so many entrepreneurs into believing Monopolies are Good.

Haven't read his book, but the idea that monopolies are good isn't typically made in a vacuum, it's made relative to alternatives, most often "ham-fisted government intervention". It's easier to take down a badly behaving monopoly than to change government, so believing monopolies are better than the alternatives seems like a decent heuristic.

layer8 3 hours ago

mrcincinnatus 4 hours ago

billiam 4 hours ago

billiam 4 hours ago

vonneumannstan 4 hours ago

Izikiel43 6 hours ago

Globalization was great for poor countries, not so much developed economies.

js8 6 hours ago

No it wasn't. Look at Joseph Stiglitz (Globalization and Its Discontents) and Ha-Joon Chang (Bad Samaritans, Kicking Away the Ladder) for counter-examples.

intended 5 hours ago

Oh come now - globalizations was great at the regional level.

It was not that great for sub groups within developed nations.

The original thesis believed that people would be retrained into other equally well paying roles.

Turns out people can’t retrain into new domains, and led to under employment.

esafak 2 hours ago

nutjob2 5 hours ago

This isn't correct. The deal is that the poor countries get development and increased employment, and the rich countries get lower prices. Generally speaking both types of countries get richer.

That some workers lost their jobs is a symptom of any change. I don't know why people always get upset people losing their jobs. It's like death, if no one died relatively few people would be born. If you resist job losses you reduce overall employment and economic development.

chromacity 5 hours ago

gradstudent 6 hours ago

I skimmed the paper a couple of times, hoping to find the promised (from the abstract)

> pathway to integrating AI into our most challenging and intellectually rigorous fields to the benefit of all humankind.

There's very little insight here though. It seems mostly a retread of conversations we've been having in the academic community for a few years now. In particular, I was hoping to see some discussion of how we might restructure our educational institutions around this technology, when the machines rob students of the opportunity to develop critical thinking skills. Right now our best idea seems to be a retreat to oral and written examinations; an idea which doesn't scale and which ignores the supposed benefits of human+AI reasoning. The alternative suggestion I've seen is to teach prompt engineering, which seems (a) hard for foundational subjects and (b) again, seems to outsource much of the thinking to the AI, instead of extending the reach of human thought.

ak_111 3 hours ago

Wait it seems like doing unscalable things - like face-to-face teaching/examination - is exactly the sort of things that humanity can afford to do as it benefits from the surplus free time generated by AI efficiently doing the scalable things.

BDPW 6 hours ago

Physical classrooms don't really scale either, is that really a fundamental problem?

bonoboTP 5 hours ago

Yes. Tools like Khan Academy help lots of talented kids to progress in the curriculum beyond what's available in physical classrooms available to them.

lo_zamoyski 6 hours ago

Indeed. Education isn't supposed to "scale". We've mucked around with education so much and subjected it to tech fad after tech fad that we hardly have anything resembling education.

Because this has been going on so long, most people's reference point for what constitutes "education" is simply off, mistaking "training" or something like that for it. But the purpose of education is intellectual formation, the ability to reason competently, and the comprehension of basic reality, which enables genuine intellectual freedom (there are moral presuppositions, too; immorality deranges the mind). This is what the classical liberal arts were about.

The very bare minimum criterion (and it is a very bare minimum) for someone to be able to claim to be educated is not only knowledge of their field, but knowledge of the intellectual nature, foundations, and basis of their field in the greater intellectual scope. I would not hold someone with only that bare minimum in especially high esteem vis-a-vis education, but even that bar is higher than what education today provides.

bonoboTP 5 hours ago

nutjob2 5 hours ago

> when the machines rob students of the opportunity to develop critical thinking skills

This is a fundamental misunderstanding of human nature. Machines don't rob people of critical thinking skills, people do. Mostly people do it to themselves, often inheriting it from their parents or social environment.

gettingoverit an hour ago

In fact, the paper has an error in the argument that AI might find Fermat's theorem to be incorrect due to definition of natural numbers including a zero, because paper's version of a theorem explicitly says that the number should be greater than two, and zero cannot be greater than two.

Surprisingly, this mistake proves the author's point that human can implicitly understand what was said, and that it still has value to it, even if it's incorrect.

sendes 6 hours ago

> We assert that artificial intelligence is a natural evolution of human tools.

While nowhere in the paper this is actually asserted but the abstract, a whiggish narrative of a genuinely unprecedented technology --such that it can replace and supersede human "labour" altogether (one is reminded of The Evolution of Human Science by Ted Chiang)-- sounds naive at best, dangerous at worst.

jebarker 6 hours ago

I don’t see why “natural evolution of human tools” implies “such that it can replace and supersede human labor altogether”. Can you clarify?

sendes 6 hours ago

A common error in historical thinking tends to see human tools essentially as a positive linear plot between time and progress. But these tools until AI had the common property of being enhancing of human cognition, because they couldn't do the thinking _for you_. AI can do just that, and for all the benefit it brings, seeing it simply as the next step in the "natural evolution of human tools" is alarmingly disarming coming from frontier thinkers.

lovelearning 5 hours ago

nutjob2 5 hours ago

Zigurd 6 hours ago

I'm glad I can still count on HN to come across the correct use of a lesser known definition of a word.

nutjob2 5 hours ago

> supersede human "labour" altogether

For certain types of labor this has always been the case.

The idea that AI will entirely replace all, or most, human labor makes no sense and is just AI hype.

Like all technology before it AI will improve most people's lives.

palmotea 4 hours ago

> Like all technology before it AI will improve most people's lives.

1. Let's be clear: what you're describing is faith.

2. And what are you smoking to assert "all technology before ... AI [improved] most people's lives"?

nutjob2 2 hours ago

GodelNumbering 6 hours ago

> Today, unlike in the Luddites’ time, we are already seeing skilled workers replaced not with lower-wage human labor, but with AI.

To me this is the weakest claim of the article. This claim been thrown around endlessly without proof.

https://fred.stlouisfed.org/series/IHLIDXUSTPSOFTDEVE

Software Engineer job openings for instance is at 2 year high (still far lower than covid dislocations though), but arguably all Enterprise AI was built or deployed in the last two years. We should have seen a crash in the job openings if the AI job replacement claim was correct.

This is something I've spend some time thinking about (personally written article, not AI slop): https://www.signalbloom.ai/posts/why-task-proficiency-doesnt...

vasco 4 hours ago

Is there a better illustration of the power of UX than the fact that a messaging chat interface was able to set free all of human knowledge from copyright, whereas a bittorrent client couldn't?

zaikunzhang 9 hours ago

mchinen 5 hours ago

He also was on Dwarkesh's podcast last week (https://www.youtube.com/watch?v=Q8Fkpi18QXU ).

I enjoyed the human->depth vs AI->breadth discussion and the waterline rising slowly to fill the 50 lowest hanging Erdos problems but struggling on the next few.

anotherpaulg 7 hours ago

Recorded 10 February 2026. Terence Tao of the University of California, Los Angeles, presents "Machine assistance and the future of research mathematics" at IPAM's AI for Science Kickoff.

dude250711 5 hours ago

It's not "the age of AI", it's just a Slop Decade.

And the tools did not become "exponentially sophisticated", one thing it's logarithmic, another is that the improvements are questionable. But "pervasive" - yes, granted.

bluecheese452 7 hours ago

Enough Terence Tao spam.

ancillary 5 hours ago

So much of HN is half-baked anecdotes about and by LLMs or philosophizing from VCs who talked to an LLM about Rene Girard for twenty minutes or pop sci articles that appear to be posted so that some bored developer can read the abstract and one experiment and dunk on it. Tao is uniquely positioned as a mathematician who has made enormous contributions to many areas and is old enough to contextualize it all against the past and young enough to be open to its possible futures. More Tao spam sounds good to me!

mchinen 5 hours ago

I haven't seen any negative sentiment toward Terence Tao before. Coming from outside the academic math sphere, genuinely curious if there's a real issue or if this comment is just spam itself.

gettingoverit 42 minutes ago

It's actually a strange situation. Tao is the only high-profile mathematician who tries to resolve the reproducibility crisis in math by popularizing proof checkers, and who used LLMs in probably the most legitimate way: to produce formal undeniable proofs with them, that cannot really suffer from LLMs being wrong all the time.

On the other hand, I still find content and arguments he produces to be quite weak, and honestly it's getting annoying to hear them that often. It's the case when he could really get some help of a ghost writer who is more experienced in popularization, otherwise this repetition might cause some serious harm instead.

myhf 4 hours ago

A big trend in AI spam is to take achievements in one field that could be called "AI" and use them as evidence of advancement in other fields that happen to be called "AI".

https://en.wikipedia.org/wiki/Package-deal_fallacy

Tao has been doing a lot of demonstrations of using LLMs for search and translation by experts who already know enough about a field to judge whether generated text is valid or meaningful. Those are valid demonstrations, but they don't justify the LLM-as-intelligent-agent narrative being pushed by most of the reporting on the topic, so the whole situation reeks of payola.

nh23423fefe 3 hours ago

tines 4 hours ago

This comment is spam. When Tao says something we should take it seriously.