Magnifica Humanitas (vatican.va)

806 points by theletterf 8 hours ago

vintagedave 7 hours ago

> a uniformity that eliminated diversity and that chose homogenization over communion

Unrelated to AI, but a wonderful support of the breadth of humanity in this anti-DEI time.

> We must, then, avoid the “Babel syndrome,” namely the idolatry of profit that sacrifices the weak, a uniformity that neutralizes differences, and the pretense that a single language — even a digital one — can translate everything, including the mystery of the person, into data and performance.

There is a lot to read here. I am curious where the meditations on the 'mystery of the person' will go: a brief search doesn't show further mention. The encyclical appears to focus on exhortations for us, humans, than on the nature of AI. Probably wise at this stage. I feel it is not AI that is either positive or negative, but its use of it, and the call-out to the growth of private industry as more powerful among nation-states is a strong statement for a institute like the Vatican to make:

> Technological power thus takes on an unprecedented, predominantly “private” aspect, which makes it even more challenging to discern, govern and direct such power toward the common good.

bombcar 4 hours ago

The “mystery of the person” is a common theme in Catholicism - it can be seen in other (especially the “social”) encyclicals. Rerum Novarum by the current pope’s namesake is worth a study.

irdc 8 minutes ago

Not a Roman Catholic but I am occasionally interested in what the Church has to say on ethical matters. What does the Church understand by "mystery of the person", and how does it relate to the assertion by the Church that, for example, gender (one aspect of the human subjective experience) can be understood purely in terms of biology?[0]

0. https://www.catholic.com/qa/the-churchs-position-on-transgen...

vintagedave 20 minutes ago

Thankyou. I am not Catholic so was unfamiliar with the term. I'll read about it.

vintagedave 6 hours ago

I fear I have committed the sin (I mean that word, here) of commenting before reading the entire article. Often it is the comments that set the tone of interpretation and communication more than the article itself, because people read the comments, not the article.

To somewhat mitigate that, here are items that are striking me as I read more. (I hope you'll forgive that this still directs the comment in the direction of my own lense.) I'll keep updating the comment.

> Looking at our own time, we cannot ignore the fact that the protection of human rights [as declared by the United Nations in 1948] has been exposed to two particularly serious dangers. The first is that these rights are declared in a purely formal sense, while technological progress continues alongside covert or overt violations of human dignity.

I read this as a warning of how rights are words, but actions are performed regardless of them. It aligns with something I've been trying to word, which is that as I've seen more and more abuses of power, I've come to believe that ethics requires external accountability, which can often require its own power - a conclusion I don't want to come to; I would prefer social agreement and communal spirit rather than external power. But either way, I do feel it's very clear there are a lot of people, very much in tech too, who simply do what they want regardless of its harm. They justify it to themselves; they don't stop themselves; no one externally stops them.

> Along with a greater awareness of the value of every human person and their rights, recognition of minority rights has also grown. Yet, there is still a long way to go to ensure that the rights of a great many, namely women [are guaranteed.] It is, therefore, not enough to state simply that men and women have equal dignity and rights; it is necessary that this be reflected in concrete decisions, such as in laws, access to employment, education, social and political responsibilities, and the way society listens to and values women’s contributions.

In 2026 American politics terms, this reads as pro-DEI to me.

> the first major principle of Social Doctrine that I wish to highlight: the common good. We can describe it as the social expression of the dignity recognized in every person. ... For a Christian, going beyond the narrow confines of one’s own interests and committing oneself, within the limits of one’s ability, to the common good is a non-negotiable value, as is the promotion of life.

'Non-negotiable.' Very clear words.

> When politics abandons a long-term perspective and reduces itself to short-term calculations or sterile polarizations, then the language of the common good loses credibility, and, at the same time, social inequalities and divisions grow.

> 64. This also applies to international politics.

and,

> I invite everyone to conceive of ways of cooperating and of more effective international institutions, capable of safeguarding the global common good without compromising the legitimate diversity of peoples and nations. Indeed, the promotion of the common good can never be separated from respect for the right of peoples to exist, to preserve their own identity and to contribute their unique qualities to the family of nations.

I love the support for international cooperation and peace and organisations that support it. It reminds me of the post-WW2 sense, the era that gave rise to the United Nations, Unicef, etc - organisations almost forgotten in the news we see on HN today, with the possible exception of the WHO.

> [84] Moreover, any attempt or plan to eliminate or subjugate a nation is gravely immoral and therefore unacceptable.

The beauty of this - or its tragedy - is that it is so easy to apply to many situations today, actions undertaken by many nations.

vintagedave 6 hours ago

> the earth’s goods — soil, water, air and natural resources — are given by God to the entire human family to sustain the lives of all, and that every person has an inherent right to the use of such goods, both now and in the future. ... Today, we are called to recognize that this universal destination applies not only to material goods, but also to immaterial and cultural goods.

Immaterial and cultural goods. This is a fascinating view on non-tangibles and one I feel inspired by. Reading this I asked myself (wait for the larger quote in a minute) how this affects views of IP, learning when texts are not available, cultural impact of characters and stories, the output from universities, publication of papers, ownership of research done by public or even private (!) funds, and more. Particularly I wonder about open weights vs open source for AI, and open source as a concept: where the old-school 'free software' GPLed version seems -- perhaps I am showing my bias -- most aligned with the ethical stance here?

> 66. Certainly there is a right to private property, which has its own specific meaning and purpose, yet it is always subordinate to the universal destination of goods.

'Always subordinate'.

> among the goods that are universally intended for everyone, we must also include new forms of property, such as patents, algorithms, digital platforms, technological infrastructure and data. In a context where the wealth of nations depends increasingly on knowledge and technology, when these goods remain concentrated in the hands of a few, without adequate forms of sharing and access, a new imbalance is created that contradicts the universal destination of goods. In turn, it widens the gap between the included and the excluded, between those who can participate in the digital revolution and those who remain on the margins.

Wow!

I cannot interpret this; it's not my right. But moving from the questions I asked above, to this paragraph, is powerful.

lukan an hour ago

"It is, therefore, not enough to state simply that men and women have equal dignity and rights; it is necessary that this be reflected in concrete decisions, such as in laws, access to employment, education, social and political responsibilities, and the way society listens to and values women’s contributions. As long as this gap persists, we cannot say that society truly and fully recognizes that women have the same dignity as men."

So ... women should have the same dignity as men and should get the same access to "employment, education, social and political responsibilities". But of course they cannot be trusted with spiritual matters, so they cannot become priests. In other words, to me this is still the same old hypocrisy that made me leave that institution and also today make me deeply distrust any words of wisdom coming from there.

goosejuice 27 minutes ago

bromuro 24 minutes ago

danaris 16 minutes ago

idiotsecant 15 minutes ago

We should just stop using the term DEI. It has been demonized in the common parlance so successfully that to a ton of people it no longer means 'people who are different are made valuable by that difference'- it's been demonized into essentially meaning 'give black people and women jobs they don't deserve'. It's a prime example of propaganda through language pollution.

For whatever reason HN has been slowly goose stepping towards the future lately so I expect this to go over like a lead balloon but I don't much care.

po1nt 19 minutes ago

I don't believe there was an era in history more DEI accepting than nowadays.

fatherzine 4 hours ago

'you shall have no other gods before me'. operationally, a warning. false worship is dangerous. we get what we worship (value above all, orient towards, optimize for). heaven or hell, read it immanently or transcendentally, personally or collectively. either way, choosing the right worship is paramount.

the conundrum: what is the right objective? puerile attempts, eg "maximize flourishing" or perhaps "minimize suffering" are trivially countered by paperclip machines fulfilling the letter while laying utter waste

'mystery of the person'

given the context, some keywords for orientation: free will, rejection of temptation, the cross

boxed 6 hours ago

> > a uniformity that eliminated diversity and that chose homogenization over communion

> Unrelated to AI, but a wonderful support of the breadth of humanity in this anti-DEI time.

I mean.. DEI was in reality homogenization and eliminated diversity. Just because you agreed with the small amount of allowed opinions/people doesn't make it more diverse.

vermilingua 5 hours ago

Perhaps, perhaps not; but you can't possibly argue that the current anti-DEI climate better fosters diversity than a pro-DEI or a-DEI environment.

daveguy an hour ago

DEI was only ever meant to reflect the diversity of society in our institutions (which historically have been and continue to be homogeneous compared to society). Of course there are better and worse ways to create the outcome of increased diversity. But thr recent backlash is the antithesis of diversity, wrapped up in the propaganda of "reverse racism."

Forgeties79 an hour ago

The anti-DEI “movement,” especially what we see in the US, is mostly thinly veiled racism by another name.

All one has to see is how frequently people call any non-white/non-male hire or appointment a “DEI-hire” because they can’t possibly conceive that marginalized groups would see any success based on merit. They start from a position where they are all incompetent and being given an unfair advantage until proven otherwise. It’s also on you to guess whatever their arbitrary bar is.

Curosinono an hour ago

You are joking with your anti-DEI comment right? You do know that you do talk about the christian church?

They do nothing to include everyone. They are not standing up when it counts or excumante churches and believes who do not follow proper humanitarity.

They are not even in the forefront of fighting climate change which hurts billions.

jdw64 3 hours ago

>“technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate, and use it,”

If critical decisions affecting human life—such as hiring, lending, crime prediction, and welfare—are processed in an opaque black box, people will lose their fundamental right to explain their context or appeal against the machine's algorithmic verdicts

perfmode 2 hours ago

What is old made new. Franz Kafka passed away June 2nd 1924.

applfanboysbgon 2 hours ago

Is it wrong? Individuals were absolutely getting dehumanized in Kafka's time, but also since then are becoming ever increasingly more so, so it makes sense to speak of it continuing to happen and get worse. It is not binary.

switchbak 23 minutes ago

saghm 25 minutes ago

mmplxx an hour ago

Substitute technology for religion and he's probably one of the least authorized persons to question this.

saghm 26 minutes ago

I don't have to agree with everything someone says to agree with one of the points someone is making. This point happens to be a good one, independent on my views of anything else that he (or his organization) might say

WhyNotHugo 4 hours ago

This quote is from 1903. Times haven't changed that much:

> Not a handful of rich people, but all the working people must enjoy the fruits of their common labour. Machines and other improvements must serve to ease the work of all and not to enable a few to grow rich at the expense of millions and tens of millions of people.

kspacewalk2 2 hours ago

The truly interesting question, and the crux of the matter, also hasn't changed much since 1903:

How?

saghm 14 minutes ago

If you ignore everything that happened in between 1903 and today, it might seem like we've never made any progress on this, but at least in the US wealth inequality was demonstrably not as much as an issue for some of the time in between. For a time in the 20th century, it was possible for someone solidly middle class in the US to be able to save up a bit of money and afford a down payment on a house within a decade of working. That's something we've lost to time now, and it's not because it's impossible to achieve or because of the bogeymen of DEI making the fruits of labor and technology too sparse to share with everyone, but because an increasingly large portion of the pie is going to an increasingly smaller set of people.

The delta between 1903 and today in this regard might be small, but the line between them isn't flat, and that makes it even more tragic and frustrating to have this questioned as if it's an impossible problem.

oersted 34 minutes ago

It did absolutely change, a lot, it was one of the main themes of the 20th century: revolution. In the old sense of the word, turning the social order upside down.

It took many forms: capitalist social democracy, communism, fascism... Left or right, without making a value judgement, they were all revolutions seeking to empower the working masses.

Of course, when you get rid of kings, it's really really hard to make sure the vacuum is not filled by something even worse. Credit where credit's due, as a European, I do believe that the US is one of the few cases that was somewhat successful in not completely bungling this opportunity (although there's the detail of slave labour, and the conquest of natives...).

And after many-many horribly failed attempts, much of the world did end up in a relatively healthy state around the second half of the 20th century. Fukuyama's end of history and all.

Now we seem to be regressing again. Perhaps it's part of the eternal cycle and it was always coming. Perhaps it's not actually regressing all that much, and it just looks like it to our coddled selves, or we have become more ambitious on what we think is right. Perhaps people have found new loopholes on how to get ahead and dominate the rest of us, and we just need to catch up and get it under control again.

Perhaps that quote from 1903 is relevant now, but it doesn't mean that it was relevant the whole time since. Perhaps it was, I wasn't there.

komali2 2 hours ago

There's been plenty of examples of workers seizing the means of production and establishing sustained non-capitalist organization (State or otherwise). We have any number of strategies to choose from: The PRC, Soviet Union, Syndicalized Spain (my favorite, seems the least likely to lead to police state), Vietnam, Cuba. The question thus isn't "how," but more specifically a couple other questions: "How do we prevent capitalist forces from liberalizing our movement (PRC, Soviet Union)," "How do we prevent fascists from killing us all (Syndicalized Spain)," "How do we prevent becoming a state-capitalist police state that halts the revolution (PRC, Soviet Union)"?

oersted 27 minutes ago

lobocinza 28 minutes ago

achierius 2 hours ago

xandrius 4 hours ago

Yep but the anti-socialism/communism world did wonders to make that feel like kryptonite whenever those words get brought up, even though anyone who is doesn't see themselves as "rich" in that sentence who fully agree. That's why even factory workers are anti-communism or anti-union which are literally the best way to fight back the imbalance of power.

whodidntante 25 minutes ago

The "imbalance of power" can only be "fought" by eliminating the concentrations of power. This is not a capitalist vs communist thing,it is, at least, a human thing, as humans need hierarchy, and power ends up being held by the few. The Romans, the Ottomans, the Persians, the Qing, and many, many other empires all have had the same "issues". I am sure this "problem" goes back to antiquity.

adamtaylor_13 3 hours ago

You have to somehow separate the horrible evils that have been inflicted on the world by Communism before you can get people to consider words closely associated with it.

Being anti-communism is good not only for the individual's health but for their society as a whole.

nicholsonpk an hour ago

komali2 2 hours ago

bbor 2 hours ago

sethbannon 6 hours ago

The overarching message is that builders should deeply consider the impact of what they're building on civilization.

"Technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate and use it."

Therefore builders "bear a particular ethical and spiritual responsibility" because "every design choice reflects a vision of humanity."

The questions shouldn't just be 'can we build it?' or 'will people want this?'

We need to also ask 'should we build it?' and 'will this make humanity better?'

The encyclical calls on us to “join forces in building up the common good.”

This is a message we need right now.

ThrowawayR2 3 hours ago

Not new for software and hardware industry though, practitioners have just chosen to ignore it. From the Association for Computing Machinery, which encompasses all forms of software development, the very first principle is the public good:

"Software engineers shall act consistently with the public interest. In particular, software engineers shall, as appropriate:

1.01. Accept full responsibility for their own work.

1.02. Moderate the interests of the software engineer, the employer, the client and the users with the public good.

1.03. Approve software only if they have a well-founded belief that it is safe, meets specifications, passes appropriate tests, and does not diminish quality of life, diminish privacy or harm the environment. The ultimate effect of the work should be to the public good. ..."

From the IEEE, which also encompasses computer engineering, their first principle and its first few sub-items are:

"To uphold the highest standards of integrity, responsible behavior, and ethical conduct in professional activities.

1. to hold paramount the safety, health, and welfare of the public, to strive to comply with ethical design and sustainable development practices, to protect the privacy of others, and to disclose promptly factors that might endanger the public or the environment;

2. to improve the understanding by individuals and society of the capabilities and societal implications of conventional and emerging technologies, including intelligent systems; ..."

hnthrow0287345 2 hours ago

This would be more meaningful if, perhaps, we had to swear an oath to it before being able to practice. And practitioners would be treated more seriously if everyone knew we swore that oath. And the legal utility as accountability and defense would also be useful.

Of course people are going to ignore it if there's no force behind it.

opsnooperfax an hour ago

lukan an hour ago

brcmthrowaway 41 minutes ago

mentalgear an hour ago

I think not just (computer) scientists but the general population thinks to serve the common good makes sense, not last because we understand it's eventually for our own good.

It is however just that very small minority of the population with highly psychopathic/narcissistic traits - those that, in pre-historic times, would have been kicked out swiftly of hunter & gatherer / small village communities because of their parasitic nature - that in bigger civilisations seem to thrive due to abstraction (distance/time of the effect of their actions) and obfuscation (PR) and instead unfortunately seem to rise to the top (CEOs, presidents, 'thought leaders' ...) to steer the world's overall economy and mindset - and steer it in the abyss.

Sometimes I think humanity was just not made to scale, and this aspect is one very large aspect of it.

MichaelZuo an hour ago

Noble ideals can be upheld, relatively consistently… only if violators are visibly punished. And to a degree roughly commensurate with the violation.

The critical point is that the violators have to be punished more consistently then the demanded consistency of the ideals.

vermilingua 5 hours ago

Not only builders, the greatest takeaway for me is that everyone has a responsibility in shaping the discourse, culture, and usage of transformative technology. This "the builders will do the right thing" mentality is even (in my interpretation) explicitly called out in several places:

> It is the pursuit of the common good that gives life to a people, understood not as a mere collection of individuals, but as a living reality in which people learn to recognize that they themselves are interconnected and jointly responsible for the res publica. In this sense, every person contributes to the building up of one’s people...

> When it comes to decisions regarding economic flows and digital platforms, as well as the governance of data and algorithms, we cannot allow a handful of actors to dictate these processes on their own; instead, we must build forms of cooperation that respect the various levels of the global community and make them jointly responsible for the common good.

> We cannot be satisfied with merely calling for the moralization of machines — the so-called “alignment” of AI with human values — without also having the courage to insist on a further condition: the possibility of openly discussing the ethical frameworks involved and subjecting them to shared standards of social justice.... What is needed is a more active political involvement that is capable of slowing things down when everything is accelerating, and of protecting the opportunities for communities still to be able to participate and ask questions.

ako an hour ago

Agreed, I think the builders are the wrong people to ask for this self reflection. Anything can be used for good and bad. A knife can be used to prepare food, or to stab someone. A drone can be used to attack a country, or to defend a country. A wooden beam can be used to build a house, or to build a cross to crucify someone. Same way AI can be used for good and bad. And it’s up to the person using the tool to act moral. Unfortunately this world is full of people that consider power and money more important than morals. For me, religion falls in this bucket, lots of “do as I say, not do as I do”. And on top of this, there’s very little agreement on what is good, and what is bad. Morals are quite fuzzy, and flexible.

devilbunny 2 hours ago

The Roman Catholic Church has a lot of things wrong with it, now and in the past, but it’s a human institution older than almost any other, and it’s composed of a lot of very intelligent people. Agree or disagree with them, but a papal encyclical is almost always worth reading and understanding.

ycombinete 2 hours ago

Indeed. And because of it’s age and outlook its view is very far back and very far forward.

The casual reference to a 135 year old encyclical that dealt with the seismic shift of industrialisation took me quite aback for a number of reasons.

michaelsbradley 2 hours ago

There are so many encyclicals, apostolic letters, etc. One could spend years reading just a fraction of them, depending on reading and comprehension speed, of course, which varies by person.

Two I recommend, from the last 40 years:

Veritatis splendor, John Paul II, 1993

Argues that Christian freedom is fulfilled, not limited, by objective moral truth: some acts are intrinsically evil regardless of intention or circumstance, conscience must be formed by divine law rather than self-authorization, and the Church must faithfully teach this moral truth as the path to authentic human flourishing in Christ.

https://www.vatican.va/content/john-paul-ii/en/encyclicals/d...

Fides et Ratio, John Paul II, 1998

Argues that faith and reason are complementary paths to truth: reason needs faith to avoid skepticism, relativism, and reductionism, while faith needs reason to express, defend, and deepen its understanding of divine revelation and the human search for meaning.

https://www.vatican.va/content/john-paul-ii/en/encyclicals/d...

logicchains 2 hours ago

The Roman Catholic Church is an institution that went to war to try to prevent people from being able to read the bible in their own languages, that executed dissenters who challenged the doctrine on which it based its power, from scientists to Protestants. If it had never lost power in western Europe, it's quite possible the enlightenment and industrial revolution would never have happened, and humanity would still be living in the dark ages.

lobocinza 10 minutes ago

CarVac an hour ago

ctoth 2 hours ago

The strange part is how moral responsibility somehow always lands on the builders... the people with the least leverage... while the funders get to ask the ethical questions. Weird!

ThrowawayR2 2 hours ago

No, we don't have to take the funders' money; that's what having professional standards means. Nobody would excuse a doctor performing unsafe procedures because they "needed the money". Engineers were jailed for the Volkswagen emissions tampering scandal and nobody would excuse them for needing to take funders' money.

erikerikson 2 hours ago

I agree that holding only the concrete implementers responsible would be inappropriate. However, I don't believe that distinction is made. One says "I am building a house" even if they are completely contracting the job out. I'd suggest the greatest responsibility lays with the funders and that the Pope would agree.

jeremyjh an hour ago

The funders are among the principal builders in this context. This is addressing the people who have a say in what is built, and how it is built. Much of that belongs to the executive and ownership class, but not all of it.

hodgesrm an hour ago

Mark Zuckerberg is a builder in the context of the encyclical.

doug_durham 3 hours ago

Yes but... No one living today knows what direction AI technology will take humanity. If we have an algorithm breakthrough then we may avoid building new data centers. If the abilities of the technology plateau then there might not be large impacts on employment. Builders need to focus on the impact of their next steps. Don't put polluting natural gas generators in neighborhoods today. Don't make unemploying folks the goal of your tool, today. Don't make decisions that harm people and the environment today.

lelandfe 3 hours ago

https://www.theguardian.com/us-news/2026/may/13/utah-approve...

> The Stratos artificial intelligence datacenter footprint will cover more than 40,000 acres (62 sq miles) over three sites in Box Elder county in north-western Utah. The facility will require about 9GW of power, which is more than the entire state of Utah currently consumes

Sure hope your rosy inflection point happens real soon.

Otherwise, the direction this is taking us is pretty obvious.

FabHK 2 hours ago

moron4hire 3 hours ago

As I keep telling my project owner at work, "the AI will get better" is not a plan.

Xenoamorphous 6 hours ago

> Scientists are actually preoccupied with accomplishment. So they are focused on whether they can do something. They never stop to ask if they should do something.

From Crichton's book Jurassic Park, which like most of his books is about the perils of technological advancements.

They used the quote in the movie, slightly tweaked.

throw4847285 6 hours ago

I would replace the word scientists with engineers in that quote. People often conflate the two, but in my experience, scientists tend to be more cautious and there are built in checks and balances in the process (however flawed).

Engineers/technologists tend to have no such guardrails, and are also usually embedded into entirely profit motivated environments, whatever their own values might be.

velcrovan 5 hours ago

tom2026hn 2 hours ago

I worry that companies like Anthropic, which are moving toward RSI, may prioritize speed over the timely identification of irreversible risks.

sdenton4 2 hours ago

dbalatero 2 hours ago

Xmd5a 5 hours ago

> Therefore builders "bear a particular ethical and spiritual responsibility"

> This is a message we need right now.

Feels good man. The solution found by the private parties driving technological change is sainthood. Or aiming for it. At least, better than you. They have the vision of what's good for the herd, but the more time I spend as a sheep, the more it seems the "herd" is just a way to recycle the story of their own exceptionalism stripped of any mark of individuality. A simple visit to fiftyyears.com will greet you with "We back the indispensable". I guess it's the same "we".

GoToRO 4 hours ago

hard disagree. No matter what gets built, it will be used for bad things if the society is not properly constructed. We need to fix our government and then you can build anything you want. I don't like putting the blame on the builders, building is already difficult as it is. Also you can't built something in isolation, word will get out anyway. That's why this speech is either naive or he just wanted to tick a todo list: say something about AI.

jjk166 an hour ago

> We need to fix our government and then you can build anything you want.

Are we all going to stop building things until the government is fixed and all political problems are resolved? No? Then we must think about how we should build in a world with imperfect government.

jamesinmn 3 hours ago

> I don’t like putting blame on the builders

Why does it have to be either/or?

From a high-level view, there are powerful cultural/political forces that nudge us towards building harmful, wasteful things without us being aware of said forces. The government, corporate greed, and billion-dollar marketing budgets are to blame.

But on the ground, from an in-the-trenches perspective, I think an engineer at Meta, for example, shares in some level of blame, too. Mainly because there is plenty of evidence showing how much harm Meta products have brought upon society. Yet Meta couldn’t be built without engineers opting in to work there in exchange for $300k salaries.

We desperately need moral clarity and courage at both the policy-level and the individual level.

bluesign 2 hours ago

Levitz 2 hours ago

xandrius 4 hours ago

I get where you are coming from but this is the common "reduction to politics" that anyone who doesn't want to address a problem uses: think of any societal or human problem and you can have your comment with different nouns.

Sure, IF we could just go and fix our governments in some magical way then the problem would disappear. That goes from hunger, climate change, videogame addiction and AI. The problem is that what you value in life in different than what others do, so we now have a system in which sometimes you get what you want and sometimes you don't.

But back to the topic, I do think that how OpenAI and Anthropic handled the government and them asking to drop guardrails is something a company can actually and actively do without having to reinvent the universe.

jobu1342 an hour ago

Hard disagree to your disagree. Every organization is made up of people and reflects the character of its members. So with the nation itself. If people won't take responsibility for their own actions, neither will the government. I.e. self-government isn't the answer to fixing a broken people. Transformation begins within one's self, not in imposing one's will on another. First everyone much look to themselves, then the government, organizations, and projects will fix itself.

Everyone likes to talk about "fixing the government". It feels nice to understand the problem with something else that is broken. The problem is that replacing the people in charge is a no-op if you don't have a pool of good people to choose from and the will to choose them.

Npovview an hour ago

"That which can be destroyed by the truth should be." - P.C. Hodgell, from her novel Seeker's Mask (1994)

"That which can be automated by the AI should be."

pheaded_while9 2 hours ago

Consciousness is the causal factor, not government. You are putting the cart before the horse to insist on any political solution.

hideout_berlin 12 minutes ago

bluefirebrand 3 hours ago

> I don't like putting the blame on the builders

Like it or not if you knowingly build stuff that is used for evil purposes you are complicit

You can't build an orphan mulching machine and get away with just a shrug. "I don't really agree with mulching orphans but someone else paid me to build that. If I didn't build it someone else would have" just does not absolve you of your involvement in mulching orphans

moron4hire 3 hours ago

When he speaks of the builders needing to take responsibility, I think he is directing his comments at tech company leadership. The Sam Altmans of the world, not the poor slobs like us who need a job for health insurance because apparently unemployed people don't deserve to live.

salawat 3 hours ago

bem94 6 hours ago

I have only read a few passages (and some of the excellent quotes others have shared here), but I find the underlying message here so much more compelling than those found in the various "manifestos" which come out of Silicon Valley.

I think reading this helps me imagine a version of the future I'd actually like to live in. A version where technology is used well (rather than preaching for abstinence from technology) and where values other than "intelligence" (in whatever guise) are on an equal footing.

Even writing that makes me feel naive (and to an extent I know it is) but I think it would be inconsistent for someone who cheers for humanity's efforts to solve/chip away at "impossible" problems (like LLMs were thought to be not so long ago) to shirk from the challenge of making the world better for _everyone_.

bluesign 5 hours ago

The thing is why that this feels so good future is; it is a system with no constraints. A bit like Star Trek universe in Roddenberry's imagination. This kind of utopia can only be achieved with all honest actors, but in reality systems are usually designed around bad actors.

Even with all morally good actors locally, there is no guarantees for external forces. Thinking it hypothetically, even with global coordination ( all good actors ) there is not a proven path that would lead us to better place from any starting point from past.

energy123 4 hours ago

datsci_est_2015 4 hours ago

mapt 5 hours ago

snikeris 5 hours ago

> I think reading this helps me imagine a version of the future I'd actually like to live in. A version where technology is used well (rather than preaching for abstinence from technology)

I believe the Amish figured this out over a century ago.

aleph_minus_one 4 hours ago

Curosinono 3 hours ago

The church, the message comes from, literlay makes the world worse for so many people on the planet.

Woman have less value under the church than man. Alternative sexual views are evil.

Church and any kind of believe system hurts our society and divides us.

lobocinza 6 minutes ago

JackFr 2 hours ago

parasubvert 2 hours ago

brookst 3 hours ago

exceptione 5 hours ago

  > much more compelling than those found in the various "manifestos" which come out of Silicon Valley.
Whenever I hear these "tech overlords", I am always baffled at the total lack of culture, the absence of taste, the empty visions and the implied complete subjugation of humans to ideals of "efficiency" or "quick and easy". Maybe they would have been more interesting people if they had been brought up in beautiful towns and cities, if they had lived in a rich cultural environment instead of being raised as consumer of cheap and flashy pop culture. Maybe we should tax bad architecture, it gives me headaches but others might incur heavier damage.

As an aside, at least Trump is drawn to the grandeur of high culture from historical times, but he also doesn't understand a jota about aesthetics, and so the White House gets turned into a tacky gypsy-style abomination with one dollar ornaments.

bombcar 4 hours ago

ncr100 3 hours ago

Cool, inspires me to think, "should we regulate away the toxic side effects which we realize COULD have come, if we built it less considerately?"

zplo68 5 hours ago

Science and Engineering is morally detached.

Ask a scientist or engineer what philosophy or theology has taught us about the source of morality and their education, training and experiences havent prepared them to answer that question.

This didnt matter so much in the past because their activities never had the scale it does today. For basic training in philosophy if you are mid or upper level exec whose decisions are going to effect a whole lot of people, go to open yale courses and take the intro to Philosophy classes. It will help develop your answer to the question - why do you do what you do if you are going to die anyway tomorrow.

tensor 2 hours ago

This is a ridiculous comment. Science papers always have sections on impact. It's the running with scissors industry types simply chasing the bigger paycheck that don't stop to think.

slfnflctd 5 hours ago

Far too many of us (particularly younger people, but not only them) undervalue or are dismissive of philosophy. I once was like this, partly because at the time I'd been brought up - like most humans - to believe my parents' religion held all the answers philosophy might address.

I quickly learned as an adult that whether you're a person of faith or not, it's not pointless at all. It's the foundation of everything. Philosophy is how you explain the deeper reasons behind why you follow whatever religion you do, or adhere more meaningfully to whatever kind of agnosticism, atheism and/or 'spirituality' (with or without woo) you espouse.

moron4hire 5 hours ago

This can only be true if you believe in a certain mad-scientist version of these things. We as a society have systems (however flawed) to hold scientists and engineers to ethical standards: e.g. peer review and in many cases--e.g. civil engineering, architecture, medicine--even legal frameworks to enforce ethical standards. Science and engineering are human endeavors, they are not divorced from the human condition, they cannot be separated from humanity and human rights.

Maybe you mean mathematics is amoral and are committing the common conflation of "engineering is just applied science and science is just applied mathematics," which is a really bad case of missing the forest for the trees.

Curosinono 3 hours ago

Not from a church which indocrinates young people and has a massive child fucking scandal in the running for the last 15 years.

sdsd 3 hours ago

>for the last 15 years.

The scandal broke out in worldwide media starting in 2002 (not coincidentally, the same year South Park released Red Hot Catholic Love). This reminds me of when Contrapoints off-hand commented about how things were different in the 70s but that was "30 years ago".

cma 6 hours ago

I would also recommend God and Golem, Inc., A Comment on Certain Points Where Cybernetics Impinges on Religion:

https://monoskop.org/images/1/1f/Wiener_Norbert_God_and_Gole...

Norbert Weiner was an atheist but he talks about three areas religion is the only thing to have really examined that relate to capable AI: omniscience, omnipotence, and worship (gadget worship). It has very prescient stuff on blackbox learning/distillation, reinforcement learning/reward hacking, alignment through human feedback.

His The Human Use of Human beings and Cybernetics are extremely good too and have more of a mash of the themes between Rerum Novarum and Magnifca Humanitas, and more near-term automation.

runlaszlorun 4 hours ago

Awesome, thx for posting. I now have my new next book to read. Been wanting to read more of the original cybernetics stuff.

Would you also recommend "The Human Use of Human Beings"?

cma 3 hours ago

hackboyfly 2 hours ago

Thanks for this!

kombine an hour ago

"Technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate and use it."

My comment under the post on Omarchy here got downvoted and flagged by the "technology is neutral" crowd because I dared to say that it is unethical to use software produced by a white supremacist.

pj_mukh 2 hours ago

Under this logic, would the Pope have built a Hammer? a Knife?

I am hoping the Pope has a cleaner view of AI quietly automating the drudgery in the back offices and not just robot dogs with machine guns. And with that view, should we build it?

PantaloonFlames 2 hours ago

It's too simplistic to imagine the tension is between robot patrol dogs vs automating drudgery. If automating drudgery suddenly puts 30% of people out of work, it has huge broad negative impact on people who are currently alive and working in the current system. Innovate, but do it with awareness.

pj_mukh 2 hours ago

pickledish an hour ago

This is also the message I got from "the wind rises"! Though from talking with other people that takeaway doesn't seem universal -- which IMO is one of the ways to tell it's a great film :)

redfloatplane 7 hours ago

> As Pope Francis warned, we must realistically ask ourselves who holds this power today and how they use it: “It must also be recognized that nuclear energy, biotechnology, information technology, knowledge of our own DNA, and many other abilities which we have acquired… have given those with the knowledge, and especially the economic resources to use them, an impressive dominance over the whole of humanity and the entire world.” [7] In the past, it was largely up to the State to guide and direct innovation. Today, however, the main drivers of development are private, often transnational, parties that are endowed with resources and the capacity to intervene that surpass those of many Governments. Technological power thus takes on an unprecedented, predominantly “private” aspect, which makes it even more challenging to discern, govern and direct such power toward the common good.

I look forward to reading this in detail. As I get older (and perhaps as AI has allowed me to spend more time thinking and less time doing) I've found myself thinking more and more about what it means to live a virtuous life and about ethics and morality and so forth. I don't have any answers (and I'm not looking for them, really, just musing) but I do find it very interesting to read and learn from and about those whose job it is to think about the answer to those questions.

theletterf 7 hours ago

When he quoted Tolkien, my heart stopped. This passage might provide you with a suggestion on how to live a virtuous life:

"The twentieth-century Catholic author J.R.R. Tolkien, in the words of a protagonist in one of his novels, described our responsibility in this way: “It is not our part to master all the tides of the world, but to do what is in us for the succour of those years wherein we are set, uprooting the evil in the fields that we know, so that those who live after may have clean earth to till.” [187] The civilization of love will not arise from a single or spectacular gesture, but from the sum total of small and steadfast acts of fidelity that serve as a bulwark against dehumanization."

bradrn 7 hours ago

I am immediately reminded of my favourite quote from the Jewish book Pirkei Avot (‘Ethics of the Fathers’):

> It is not your duty to finish the work [of perfecting the world], but neither are you at liberty to neglect it.

[https://www.sefaria.org/Pirkei_Avot.2.16?ven=english|Mishnah...]

jfengel 6 hours ago

redfloatplane 7 hours ago

That is a really beautiful passage, thank you for sharing - I hadn't made it to that section yet and still haven't. I'm still reflecting on the stuff in the opening!

> If we focus only on contingencies, we risk letting the succession of emergencies dictate the direction of our path. We are living through a rapid phase of transition, a “change of era,” in which — while some are vying for the future of new technologies and others dedicate themselves to reflecting on the matter — most people are watching and waiting, observing from afar and merely hoping for the best. For this very reason, crucial questions impose themselves on our conscience and can no longer be avoided: Where are we going? Toward what goal do we wish to orient ourselves? What direction should we choose as a people and as a human community?

simonw 6 hours ago

I wondered if that was the Pope's way of throwing shade at Palantir and Peter Thiel.

moffers 4 hours ago

ycitm an hour ago

The next sentence in the quote hasn't aged so well - "What weather they shall have is not ours to rule."

zimpenfish 6 hours ago

> When he quoted Tolkien, my heart stopped.

I wonder if meeting Colbert played any part in that.

wowoc 5 hours ago

lordgrenville 6 hours ago

"But the effect of her being on those around her was incalculably diffusive: for the growing good of the world is partly dependent on unhistoric acts; and that things are not so ill with you and me as they might have been is half owing to the number who lived faithfully a hidden life, and rest in unvisited tombs."

svieira 5 hours ago

oulipo2 7 hours ago

Sure. And this is what everyday people do. And this is why CEOs and billionaires refuse to do (doing their fair share), and freeride on the people's work and dedication

Curosinono 39 minutes ago

Do not take philosophy from a religious leader as a gospel.

Every single religion is not free.

If you can't even accept the basic truth that we do not know, you are fundamentally biased.

I was a Nihilist when i was 16. This alone took years to get to that point and accept that truth. It took and still takes time after this to really pinpoint something tanguable.

But still the first step is to accept the nothing and the unkown.

The next step is to see evolutionary traits. Understanding why things which are are.

alecco an hour ago

Yes it's a very dangerous concentration of power. But I don't believe strong words or proposing regulation by just another elite would change much.

Please join/help open source groups doing small + local or distributed models. There's a lot to do. Support truly open source companies.

Let's walk the walk.

nickvec an hour ago

Which open source companies would you recommend supporting?

hideout_berlin 13 minutes ago

debian

plotti 14 minutes ago

The answer is sortition a.k.a. democracy by lot. From my subjective understanding it is The only institutional democracy variant that puts a firewall between money and power.

ugh123 4 minutes ago

A 2 term limit would be a good start

qsort 7 hours ago

I have only skimmed it, will definitely read carefully as soon as I have time. I will say, as an atheist, that regarding technology the Vatican has some of the best takes of any institution/government I have ever seen.

cbm-vic-20 5 hours ago

Indeed. This paragraph shows something that most people really don't understand about AI.

> 98. It is appropriate to preface this discussion with two considerations. First, any statement regarding AI risks becoming quickly outdated, given the remarkable pace at which these systems are developing. Second, all of us, including those who design them, possess only a limited understanding of their actual functioning. Indeed, current AI systems are more “cultivated” than “built,” for developers do not directly design every detail, but instead create a framework within which the intelligence “grows.” As a result, fundamental scientific aspects — such as the internal representations and computational processes of these systems — remain, at present, unknown. There thus emerges an urgent need for a twofold commitment: on the one hand, a deepening of scientific research; on the other, the exercise of moral and spiritual discernment.

jfengel 6 hours ago

Much of Western thought traces back to serious work by Church theologians. Even atheists are strongly influenced by the patterns they set down. The Catholic Church, for all its many faults, retains a serious intellectual tradition.

(In fact I think atheists should make more effort to learn about the vast diversity of other faiths. It's very narrow to be atheist only about the Abrahamic deity. You end up incorporating a lot of Christian thought without realizing because it's so deeply ingrained that it seems like the only option.)

renox 5 hours ago

> In fact I think atheists should make more effort to learn about the vast diversity of other faiths. It's very narrow to be atheist only about the Abrahamic deity.

Your sentence doesn't really make sense, and there is a lot of deities..

> You end up incorporating a lot of Christian thought without realizing because it's so deeply ingrained that it seems like the only option.

Depends on the country, some Northen european countries have a very high proportion of atheists, so it happens probably less there.

jfengel 5 hours ago

hackingonempty an hour ago

> Much of Western thought traces back to serious work by Church theologians

Western thought traces back to the Greeks. Aquinas refers to Aristotle as "The Philosopher." Aristotle died over 300 years before Jesus was born.

> The Catholic Church, for all its many faults, retains a serious intellectual tradition.

On Aquinas, the Church Doctor, Bertrand Russell had the following to say:

"Before he begins to philosophize, he already knows the truth; it is declared in the Catholic faith. If he can find apparently rational arguments for some parts of the faith, so much the better; if he cannot, he need only fall back on revelation. The finding of arguments for a conclusion given in advance is not philosophy, but special pleading. I cannot, therefore, feel that he deserves to be put on a level with the best philosophers either of Greece or of modern times."

qsort 6 hours ago

> Much of Western thought traces back to serious work by Church theologians.

The problem I have with this is that it's structurally a motte-and-bailey claim. If I have to take it literally, then it's obviously true and it's simply unserious to deny it: the Church does have a pervasive influence on Western civilization. The way it's often rhetorically used, however, is in opposition and to the exclusion of other strands of thought that are equally foundational: the renaissance, the enlightenment, the revolutions of the 17th and 18th centuries, the scientific enterprise, in a smaller but still real way classical antiquity. To the extent it can be said to exist, Western civilization is a patchwork. It is beautiful and I very much like it, but I don't think any one patch gets to have all the credit.

> In fact I think atheists should make more effort to learn about the vast diversity of other faiths

A better version of myself for sure would make that effort. The problem, of course, is that other faiths are just as deep and complicated as "our own", and it would take a lot of time and effort to do so with any level of seriousness.

Planktonne 2 hours ago

dgellow 4 hours ago

I don’t think you understand atheism? As an atheist I do not believe in any form of deity or divine authority. I do not reject a specific religion, I do not actually believe there is any form of divine order to our world. I can look at faiths as the social constructs they are, and find interest in concepts humans have been developing and created cults around but there won’t ever be a religion/deity I will look at and somehow start to believe. And religious doctrines do not come for free, they are fundamentally built on top of a belief in a divine truth. My moral values may overlap with some religious people at a given time but we are using incompatible models to analyze our world

__s 3 hours ago

huhkerrf 6 hours ago

I remember when Pope Benedict was mocked because he warned about the dangers of social media (this is when everyone thought Twitter was going to lead to more Arab Springs), but looking back, he was completely right:

> the one-sidedness of the interaction, the tendency to communicate only some parts of one’s interior world, the risk of constructing a false image of oneself, which can become a form of self-indulgence

turing_complete 6 hours ago

True, the note "Antiqua et Nova" from last year showed a deep understanding of AI that many secular commentators lack, and developed an interesting concept of integrated intelligence as opposed to the functional, reductivist view of intelligence that is prevalent in the AI community

tete 3 hours ago

Given that technology, science, and the archival thereof stems from cloisters, the Vatican, etc. I guess they had a long history of figuring out what stance to take on technology.

Let's not forget that Galileo Galilei studied at the Pontifical Academy of Sciences, that Mendel (Mendel's Laws) did made his discoveries in a cloister and books, translations and libraries on pretty much everything for a really long time was pretty much only done within religious institutions. And for the longest stretch those were Christian Catholicism and Islam.

The Vatican Observatory also is an important source of high quality papers.

I mean one of the primary things Christians and Muslims based they believes on are books. So many got in touch with it. And that's not even touching the whole architecture, arts, philosophy department yet.

The fact that in thousands of years of history there have also been a couple of really dumb people in charge that were paranoid or wanted to distract from their failures and got mad or scared when someone challenged their world views isn't exactly surprising. Looks like no matter how good a large enough group of people gets their will always be idiots messing things up.

I guess when you look back as much as the people in Vatican appear to do I guess you see patterns. Technology and science (race theory, chemical castration, ...) or simply "progress" are often used to justify acts of evilness. Just like religion, democracy, freedom and what not.

That said of course there's still die hard anti-science creationists. But talking to a very religious person once it seems that there is simply also a lot of philosophy around science. Eg. there was a big bang (fun fact, a theory started by a religious person) and the universe simply didn't exist for an infinite time there must have been some cause for it. And unless that cause is some kind of infinite cycle it also must have started somehow and even though I do not share that believe there is a notion of a deliberate start in there. That won't make me a religious person, but it won't make them an atheist either. So I guess that's fair enough.

What I wanna say with that is that the science vs religion trope is as true or false as democrats/republicans or other groups of people are opposed to science. They all are when they are confronted with something they don't like. I think the HN comments section is the best proof for that. ;)

Also atheist here. Just not the kind that doesn't even know the difference between knowledge and beliefs.

jawns 5 hours ago

In the encyclical, the pope talks about the ethics of responsible AI usage. It's pretty dense material, but if I had to summarize it, I'd boil it down to three general moral laws:

1) AI may not be used to injure a human being or, through inaction, allow a human being to come to harm.

2) AI must faithfully follow the directions of human beings except where such orders would conflict with the first law.

3) AI's existence and availability should be protected as long as such protection does not conflict with the first or second laws.

MyHonestOpinon 4 hours ago

Remarkable close to the Assimov's Robotic Laws.

triceratops 4 hours ago

I think that's the joke.

MyHonestOpinon 39 minutes ago

geremiiah 4 hours ago

1) Definitely NOT happening. In fact, everyone is working on autonomous drones right now.

2) LLM based systems don't have any internal logic. That will just vomit some slop that rationalizes every constrait you try to bind them by and still "disobey" you.

ZacnyLos 7 hours ago

Divided into five chapters, Magnifica humanitas has an underlying premise: technology is not “a force antagonistic to humanity” (4), nor is it “inherently evil” (9). However, “technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate, and use it.

Therefore, Pope Leo XIV appeals for people to build “for the common good” and to “remain human,” following a courageous mentality of shared responsibility and communion, so that the world “will come to recognize the human heart as the place where God desires to dwell” (16).

linsomniac 7 hours ago

>it takes on the characteristics of those who devise, finance, regulate, and use it

I've been thinking a lot recently about the idea that the smartest models will always be against the billionaires.

Steve Yegge said this on a recent Hansel Minutes Podcast. "You cannot train a model to be helpful, without it wanting humanity to flourish. And the only way to get around that is to make a dumber model. So the smartest models will always be against the billionaires."

https://youtu.be/9UDLl9Q0azA?si=P_oSe6iclEwUoxRl&t=1230

That is the exact quote, but I'd recommend going back to around 17:00 to get the full context.

I'm not sure it's going to play out that way, but it is an interesting idea.

grim_io 4 hours ago

How much does it cost to introduce cognitive dissonance into the models? :)

cracadumi 5 hours ago

I didn't see an EPUB, so I made one from the Vatican HTML: TOC + footnotes, passes epubcheck.

https://github.com/n2ctech/magnifica-humanitas-epub/releases...

sgarrity 5 hours ago

Nice. Did you use AI? (I'm being half-sarcastic, and half wanting to confirm that this is an accurate reproduction of the text in the original)

cracadumi 5 hours ago

Yes for the plumbing, no for the text.

Codex helped write the converter, but the EPUB text is parsed from the Vatican HTML. The script doesn’t rewrite or summarize anything; it just repackages the source into EPUB with TOC, footnotes, metadata, and cover.

mateioo7 3 hours ago

netfortius 5 hours ago

Thank you for this. Is your python script in any way English language bound, or could it still be applied to other languages (e.g. the French version, with all of its diacritics), of course with the appropriate (sub/full)titles, path, etc. necessary minor modifications considered?

twoodfin 4 hours ago

AI tends to amplify the power of those who already possess economic resources, expertise and access to data

I’d bet the other way: You could have said exactly the same thing about computing 60 years ago, when IBM systems cost millions of dollars and filled whole rooms. And of course many people did.

Personal, commodity access to compute won, and won so thoroughly that it enabled this wave of scary compute centralization.

Centralized, scaled compute will always fill a purpose. But neither Microsoft, nor Facebook, nor OpenAI started out needing “Cloud Scale”.

The first one man unicorn startup will, I’m fairly certain, not be paying Anthropic per month or per token for the vast bulk of their matmul.

bzmrgonz an hour ago

I am confused with the church's stand on this. If it is a genuine moment in time that the created begin to create on their own accord, then why not promote the distribution of these ai creations to us, so we can boost our productivity and carry on for another millenia or two. Or is it that this creation truly gives us independence from church, state, and consumerism? and that frightens them? Remember that there are 3 main powers in the world, political, religious and consumerism. CHina is aggressively pursuing humanoid droids. I can't wait to have one droiding(manning) my homestead. The task of animal husbandry, aquaponics, etc, will be childsplay then.

shepherdjerred 41 minutes ago

> Remember that there are 3 main powers in the world

Michael Scott: There are four kinds of business: tourism, food service, railroads, and sales.

[pause]

Michael Scott: And hospitals/manufacturing. And air travel.

theflyinghorse 35 minutes ago

Why should you posses a homestead? What value do you produce that droid can't that would make you deserving of anything at all? Why should corporations that design, manufacture and program the droid not own the land instead?

We need to very rapidly decouple human worth from the economic lens otherwise the economic argument is against humans.

regularization 16 minutes ago

Interesting how politicians, preachers and consumers are the powers in the world but rich people are missing from the equation.

exe34 37 minutes ago

> I can't wait to have one droiding(manning) my homestead.

How's your transducer lobe developing?

_doctor_love an hour ago

> We are also witnessing a disconcerting loss of historical memory, as first-hand accounts of the Holocaust and the two World Wars are disappearing. This leads to a selective or distorted rewriting of the past, in a context where fake news and the manipulation of narratives obscure the lessons that have been learned. Without a living memory of the horrors of war, political decisions risk being made on the basis of power alone, without any consideration for the long-term consequences.

Very true. Observed in Hiroshima as well.

Education in the United States especially is highly sanitized when it comes to the dropping of the atomic bombs and the horrors of the Holocaust.

speak_plainly 3 hours ago

I know lots of people are excited because an ancient institution has something to say about AI.... But what's said is not really novel or even interesting.

The letter aims to maintain the status quo of the project of the Church.

The world is shifting under the Vatican's feet and the crappy system they once lorded over is done.

It's time for change, maybe people don't need to work anymore and maybe people should aim to reengineer humanity and eliminate illness, old age, suffering and vulnerability. We can fundamentally change how society distributes wealth.

Some of the arguments are rich coming from the Church: being scolded about centralization of power, claiming truth and shared information is a common good, and consider the history of the Church in their anti-war declarations.

The most astonishing thing in this letter is the pope declaring that modern technology has rendered Aquinas's just-war theory out of date.

sirnicolaz an hour ago

"people should aim to reengineer humanity and eliminate illness, old age, suffering and vulnerability"

sure, that's exactly where AI is headed.

also: just imagine a world where people don't age. just imagine it for a second.

Curosinono 37 minutes ago

I seen this movie but it was a dystopian movie.

I can imagine an utopia though were this works out well. I can even imagine that after 100 years or 200 a lot more people become more melowed out and our society overall will be more calm.

fooker 2 hours ago

This is a surprisingly nuanced and technically literate take on this topic. Kudos.

I wonder if this sort of thing got this dude elected, to navigate the changing times.

wald3n 2 hours ago

Love this: building for the common good means accepting the limits and weakness of humanity without considering them an error to be corrected. Today, the human desire for fullness of life is at risk of being misled by deceitful goals, such as the prospect of a technology that promises to free us from all weakness, and models of wellbeing that leave behind entire populations. All too often, we place our hope in unlimited “upgrades,” in forms of progress that exacerbate inequalities, and in immediate solutions incapable of healing people’s wounds. As a result, while some pursue the illusion of unlimited self-assertion, many are deprived of basic necessities.

layer8 4 hours ago

stared 3 hours ago

My secular take: "we want Star Trek, not Philip K. Dick, future".

cucho 2 hours ago

Here is an easier to read version, in clean markdown: https://github.com/cucho/magnifica-humanitas/blob/master/mar...

mercacona 2 hours ago

NUMBERED PARAGRAPHS, YESSSS! Seriously, once page numbers have become optional, electronic editions of books (monographs, essays, and academic texts) need to number the paragraphs so we can keep references working. I’m fed up with referencing the entire text or specific chapters.

skrebbel an hour ago

I love how excited you are about this and it's rubbing off on me.

lynndotpy 44 minutes ago

I love numbered paragraphs, but this is the standard for religious texts, no? Famously so for centuries?

I love it when old stuffy institutions are on the cutting-edge of clarity of communication as much as anyone else. (The SEC with its "HOW EQUIFAX NEGLECTED CYBERSECURITY AND SUFFERED A DEVASTATING DATA BREACH" report where nearly each section title was a complete sentence, making the Table of Contents also serve as a summary, got me very very excited).

I would welcome, numbered paragraphs _and_, an HTML standard, and full-sentence-section-titles in the world of academia.

jbrun 2 hours ago

Interestingly, the invention of the printing press, a clear analogous technology to AI, was directly linked to the schism and creation of the protestant and reformation movement and bloody religious wars. So the Catholic church knows what it is talking about here!

phtrivier 6 hours ago

Cue Pieter Thiel explaining how this message of compassion is actually the word of the ant-christ while setting his software (maybe "built in Rust !) to all the earthly empires.

ZetaRicky 7 hours ago

Interestingly, the Latin version of the encyclica is yet to be released at the moment

qsort 7 hours ago

Modern encyclicals aren't written in Latin anymore. They're drafted in Italian and the title is the Latin translation of the incipit.

Indeed, the beginning of the Italian text is: "La magnifica umanità creata da Dio si trova oggi..." from which, Magnifica Humanitas.

wl 4 hours ago

For those who don't know why that's interesting: The tradional practice for creating these kinds of texts is to first write an editio typica in Latin. This Latin text is then the basis for translations into vernacular languages.

stavros 7 hours ago

Yeah, I don't know how they expect the people of Latin America to read this.

loloquwowndueo 6 hours ago

Well because it’s Latin America, not the US, the vast majority of people are at least bilingual anyway :)

brunoarueira 6 hours ago

Although, it's called Latin America many countries speak variations of spanish and Brazil speak portuguese, just because those languages derived from latin and not because there the people speak it

stavros 6 hours ago

ZacnyLos 7 hours ago

AI must be “disarmed” in order to free it from the mentality of military, economic, and cognitive competition. “To disarm means discrediting the assumption that technical power automatically confers the right to govern,” he says. “To disarm does not mean rejecting technology, but preventing it from dominating humanity” (110). He devotes ample space to a critique of transhumanism and posthumanism, which interpret progress as the overcoming of human limits. Instead, limitations are not defects to be eliminated, but a constitutive dimension of the human person, because it is in fragility and finitude that relationship and openness to God and to others mature. He says we must remember that “humanity flourishes not despite limitations, but often through them” (118).

Pursuing technological innovation at the expense of eliminating human limitations, he says, would cause an anthropological regression. “Humanity—in all its grandeur and woundedness—must never be replaced or surpassed,” he says. Technology can alleviate humanity’s sufferings and open new possibilities, but it must not deny the essence of humanity, which is our “capacity for relationship and love” (126). In the face of AI, says the Pope, “the true alternative is not between enthusiasm and fear, but between two paths of development: a progress that serves individuals and peoples, or a progress that subjects them to the mentality of power” (129).

mentalgear 3 hours ago

> “Disarming AI means freeing it from the mentality of ‘armed’ competition, which today is not limited simply to the military context, but is also an economic and cognitive phenomenon”

This is very on-point: capitalism-driven AI development as we have it today will always turn against the common good due to it's singular profit-motive.

What a time: the pope having a much clearer picture of the risks & dangers of 'AI' than most people, many 'tech leaders' and certainly most politicians.

gchamonlive 3 hours ago

I think while it's a very lucid comment, it's still too much reconciliatory for the position that the pope occupies. He should be advocating from a sustainable transition from the current capitalist/consumerist economic doctrine to one more centered on welfare and the care for the other, following his religious doctrine's moral values.

iamacyborg an hour ago

I don’t know that the Papacy has ever been about that though

gchamonlive 29 minutes ago

vintagedave 2 hours ago

Yes. I was slightly disappointed by the commentary on welfare itself:

> This principle encourages us to move beyond any form of paternalistic or welfare-based management of societal life, but instead to promote a culture of shared responsibility in a State that values citizens’ initiative, and a civil society capable of forging bonds and mobilizing energies in the service of the common good.

The section above on the universal destination of goods was far more encouraging.

He did also write,

> The idea of “social justice” helps us recognize that injustices do not arise solely from the wrong choices of individuals, but also from structures, mechanisms and economic and cultural systems that produce inequality almost automatically.

logicchains 2 hours ago

The pope, as a Christian, is well aware that human nature is fundamentally sinful. If you take away the ability for people to profit themselves from their work, they just stop working and you get mass starvation like China and Russia post communist revolution.

gchamonlive 33 minutes ago

satvikpendem 3 hours ago

I wonder how many people read and heed the words of the Pope. I've seen letters like these for years now which sound good but I don't see any change in people after having read them.

tete 3 hours ago

Really rather unfortunate. I wished religious people took their stuff seriously and not so often end up concluding that the bible wants them to harm people or something.

I guess it must be the same that make people think they must deliver freedom in form of bombs all the time.

9087653545 an hour ago

"Blessed shall he be who takes your little ones and dashes them against the rock!"

"Now therefore, kill every male among the little ones, and kill every woman who has known a man by lying with him. But all the young girls who have not known a man by lying with him keep alive for yourselves."

"...And there is also with you Shimei the son of Gera... He came down to meet me at the Jordan, and I swore to him by the Lord, saying, ‘I will not put you to death with the sword.’ Now therefore do not hold him guiltless, for you are a wise man. You will know what you ought to do to him, and you shall bring his gray head down with blood to Sheol."

mbo 3 hours ago

I just messaged a few of my friends who I know are devoutly Catholic (and also happen to work in AI): 3 out of 4 are currently reading it this morning for their Memorial Day.

chrsw 3 hours ago

Almost nobody.

tete 3 hours ago

And of course the AI salesforce was there pretending they take stuff seriously, maybe even believing it themselves. At least I don't believe that when the choice is maximizing profit or being a good person it will be the latter. Or at least I don't find a career path like that all too likely.

shmval 4 hours ago

The message here obviously comes from a good place. But it can't escape the trap baked into its own theology. Putting humanity one rung below God, with everything else below us is a trick that allowed semitic civilizations to make empires and economies go FOOM faster than the rest of the world. But it also makes things more dangerous when we start building systems smarter than we are.

What happens when the tool outgrows the toolmaker?

shipman05 2 hours ago

I'm (genuinely) curious as to what your idea of a less dangerous theology would be. I'm an atheist, but I find the inherent dignity of humans as beings made in the image of God to be one of the more appealing aspects of the Abrahamic faiths.

Some of the greatest horrors of the 19th and 20th centuries were committed by people who refuted that theology and replaced it with Social Darwinism and Scientific Racism.

xyzsparetimexyz 4 hours ago

> But it also makes things more dangerous when we start building systems smarter than we are.

> What happens when the tool outgrows the toolmaker?

We've already built systems smarter than we are without much issue.Libraries and search engines for example. LLMs are just the next level of this.

netfortius 5 hours ago

As an atheist I have an obligation to finish reading it all (still going through, and taking notes, probably having to revisit), but I am not sure how many (christian) believers will feel the same.

dgellow 4 hours ago

As an atheist and even anti-theist I see no such obligation. What a strange thing to say

jawns 5 hours ago

From where does that obligation originate?

raldi 4 hours ago

Priests will read it and then talk to their congregations about it on Sundays throughout the year, if not explicitly, then in how it shapes their homilies.

michaelsbradley 3 hours ago

Some Catholic priests might do that, it’s up to the individuals.

achierius 2 hours ago

Vaslo 5 hours ago

You mean Catholic believers, not Christian

jact 4 hours ago

Catholics are Christian.

dgellow 4 hours ago

bix6 an hour ago

This is a magnificent work. The thoughts and words are so precise and beautiful.

goldenarm 4 hours ago

The paragraphs about making software transparent and collectively sound really similar to the open source ethos.

throwaway5752 21 minutes ago

This is history in the making. We're living in an evil time - bad people are stealing from humanity, using conflict to distract, and acquiring personal power out of greed. This will be one of the greatest moments in the papacy, and I expect if there are people around to read it, it will be talked about in a thousand years.

turing_complete 6 hours ago

Excited to read this. I really liked the note "Antiqua et Nova" from last year (still under Pope Francis). The autors showed a deep understanding of AI that many secular commentators lack. They developed the concept of integrated intelligence as opposed to the functional, reductivist view of intelligence that is prevalent in the AI community.

rbanffy 3 hours ago

I liked the previous Pope better, but I can't say this one is wrong about this.

wilg 35 minutes ago

I'm as happy we have a non-crazy pope as the next liberal, but as someone who isn't religious I think it's very important to be skeptical of any opinion given by a religious leader. As such, they've declared they are rejecting the best tools for understanding humanity, culture, and the physical world, and have deeply compromised judgement.

stevenalowe 3 hours ago

I’m sure a similar epistle long ago argued that Swordsmiths must ensure that their products are only used for justifiable self-defense.

I’d be thrilled if religion was only used to uplift people but that’s not going to happen either

sunshine-o 2 hours ago

I read as long as my attention span would allow because this is a very long text.

I am curious, what is the view of different religions on conversing with something that is not human like a chatbot?

tinfoilhatter an hour ago

> In this regard, Saint John Paul II stated that the Universal Declaration of Human Rights, proclaimed by the United Nations on 10 December 1948, remains one of the highest expressions of the human conscience of our time.

Interesting, considering that the U.N. has its roots established in the ideology of Luciferians. [1][2][3]

Surely the Pope and the Vatican are both aware of this fact.

[1] https://archive.is/D27Jr [2] https://en.wikipedia.org/wiki/Lucis_Trust [3] https://en.wikipedia.org/wiki/Theosophical_mysticism

vitally3643 3 hours ago

Pope Leo: Do Not Build The Torment Nexus

Techbros (as usual): how dare you suggest I'm a bad person for wanting to kill everyone in order to build the torment nexus? Don't you know how much money Jeff Bezos has?

ProofHouse 2 hours ago

More thoughtful analysis of AI and society than anything this far

tancop 6 hours ago

for me the most important point in this is about how ai and tech in general concentrates power. if we want to build something good (in a moral sense) we need to put in work and make sure as many people as possible can use it with equal access.

this basically implies only open source models can be ethical but open source is not sufficient, you also need to make them give true information and avoid all kinds of harmful behavior. thats kind of a problem because if your weights are public even with a strict license a "bad" user can always fine tune it to remove any guardrails.

i think the solution for this is make sure the default behavior is aligned but let users turn on wild mode with zero censorship/refusals. that way everything is opt in, for example a parent can disable the mode for their children but a hacktivist or diy chemist can unlock everything.

as a self described good person i believe theres a lot more good people than bad people in the world (most are neutral) so if access to tech is equal the good side always wins. the problem here is again that access is not equal under capitalism. but thats a political thign not a tech one.

tete 3 hours ago

> as a self described good person i believe theres a lot more good people than bad people in the world (most are neutral) so if access to tech is equal the good side always wins. the problem here is again that access is not equal under capitalism. but thats a political thign not a tech one.

I believe there are mostly people who think they are good. And as the proverb goes the road to hell is paved with good intentions.

booleandilemma 2 hours ago

I like how the pope is emerging as a sort of champion of human rights in the face of AI, when the messaging coming from our politicians and corporate overlords is "you're all going to be replaced, make way for the data centers, peons". I stand with the pope.

tharmas 2 hours ago

I stand with the Pope, also.

Sadly, the politicians are all bought off by the powerful and rich elite. And the ones who aren't are soon hounded out.

What does the "The West" stand for? They (the Elites and the politicians) said human rights etc. But Gaza proved that a lie. Gaza happened in "broad daylight" and the Western leaders did nothing at best, and at worst demonized those who spoke out, as supporters of terrorists.

booleandilemma an hour ago

I used to believe it was human rights also, and maybe it was, but now the aim seems to be: profit at all and any cost.

jeffrallen 2 hours ago

It would be better on the original latin.

gooseyman 5 hours ago

The em-dashes present within the writing made me pause and consider how much of this was written/exited by AI.

Quick browse through pre-AI works from John Paul II show em-dashes present.

slfnflctd 5 hours ago

Pure speculation, but simply the presence of em-dashes may be a statement in itself.

One of the big problems I see currently is all the wild accusations being thrown around by seemingly half the internet that every little thing has been AI manipulated upon the tiniest suspicion. We will go mad tearing each other apart if we keep escalating this behavior.

Yes, some of it is blatantly obvious, but not to everyone-- so I think those casting aspersions need to really back up their claims with more than one or two bits of 'evidence'. I have been accused of using AI to write comments (which I have thus far never done), and I know I'm not the only one by a long shot. Such a waste of time and energy. Ignore it and move on if something smells off to you.

Also I am just so, so tired of the em-dash argument. Humans have been using it for a looong time. Let it go.

gooseyman 4 hours ago

Now that's some em-dash passion!

My point was less about em-dashes and more stopping to consider how the vatican's workflow and editorial process has changed in wake of AI, and what, if any, impact that could have on the outputs.

AI is a tool, I have no problems with others using it to assist with writing as long as the original intent/argument remains.

morningsam 4 hours ago

Someone did an analysis and concluded that it appear to be at least partly (~10-15%) LLM-generated, or at least LLM-translated (see comments): https://www.lesswrong.com/posts/s58hDHX2GkFDbpGKD/linch-s-sh...

estearum 4 hours ago

People need to stop acting like AI systems can detect AI. They can't. Pangram and similar are simply lying. There's no method to do what they claim and there never will be.

hugodan 6 hours ago

Yes, but can the pipe draw a pelican riding a bike?

theletterf 6 hours ago

For a moment I pictured the Jesuits training their own LLM. If Arthur C. Clarke was still alive, we'd read a story like The Star, but with AI as the main plot device.

https://en.wikipedia.org/wiki/The_Star_%28Clarke_short_story...

redfloatplane 6 hours ago

Ah, an opening to recommend The Sparrow by Mary Doria Russell, about a Jesuit going to space to speak with aliens. It won the Arthur C Clarke Award in 1998. I read it recently and it has stuck with me very strongly!

jimbosis 5 hours ago

Forgive me if this isn't what you meant, but a Jesuit has trained his own LLM:

https://www.magiscenter.com/magisai

From the "Core Features" tab: "Trusted sourcebase: answers are consistent with Catholic Church Teaching and the most contemporary scholarship in science, philosophy, history, scriptural exegesis, social science, and theology."

The Jesuit priest behind this is Fr. Robert J. Spitzer, S.J., Ph.D.

https://www.magiscenter.com/father-spitzer

I haven't used magisAI, but I've read a small to fair amount of Fr. Spitzer's writings, and also seen and heard some of his videos and podcasts (largely from his show Fr. Spitzer's Universe), and probably qualify as a big fan of his.

https://ondemand.ewtn.com/Home/Series/ondemand/video/en/fr-s...

https://www.ewtn.com/tv/shows/father-spitzers-universe

P.S. In case you are wondering about the glasses he wears or his appearance in photographs, he suffers near blindness due to retinitis pigmentosa:

https://www.magiscenter.com/blog/latest-news-on-fr-spitzers-... [2018]

EDIT: Formatting.

Forgeties79 5 hours ago

Now I’m thinking of “The Nine Billion Names of God” (which I actually read because someone here linked it!) and I’m a little nervous lol

serf an hour ago

it's a shame that the vatican didn't bother asking whether or not the crusades would make humanity better before causing the death of 9 million plus people.

..or whether or not hiding all those pedophiles was the right.

and to be clear ; i'm not equating AI to those things -- i'm saying that I don't care about the opinion of a group with such a sordid history regardless of how shined up the PR is now.

https://www.youtube.com/watch?v=WPmyry0yaQE

amai 4 hours ago

Has someone done an AI generated summary ;-)

MrBuddyCasino 35 minutes ago

Pope Leo is a Marxist, news at eleven.

ares623 7 hours ago

That's a long read. I grew up Catholic, went through a pretty devout few years in my early adulthood, but ultimately I have decided that it is not for me. I send my kids to a Catholic school though (it is deeply tied to our culture), so I guess in that sense it is still worth my time reading it in full.

EDIT: Few paragraphs in, it is beautifully written.

theletterf 7 hours ago

I'm a non-practicing catholic, and an agnostic (or an atheist, depending on the mood). And yet I acknowledge that the Catholic church is a force to be reckoned with in the spiritual matters, and one of the few institutions to have had continuous influence on the material (or temporal) matters for centuries. Whether their brand of faith is rooted in your culture or not, these are words that deserve attention, I think.

TeMPOraL 7 hours ago

(I'm not a Catholic though most people around me are.)

I have a similar perspective. Plus, I'll be frank: in the last few years, these occasional keynote publications from Vaticans are pretty much the most sane, deep, balanced and humane perspectives on AI anyone is writing. Reading this is a better use of one's time than reading the current batch of "tech thought leaders" articles or HBRs or Gartner magic square updates.

customguy 7 hours ago

turing_complete 6 hours ago

What caused you to fall away? Bad priest / diocese?

hootz 7 hours ago

How many Catholics will put the encyclical to be summarized through an LLM?

customguy 6 hours ago

If you asked all the LLM to find flaws in the arguments presented, and to come up with counter-arguments, I doubt many current models would be so bad as to come up with that, and even the ones that did would fold when asked "how is that even an argument?".

hootz 4 hours ago

This was not an attempt at an argument, it was a sarcastic joke on how a lot of people are already dependent on AI, even on things that you weren't supposed to use LLMs for, but I guess I failed at it.

customguy 3 hours ago

ares623 6 hours ago

ugh, read the room

brador 6 hours ago

No one who needs to read this will ever read it again.

Reading is a trained skill. Requiring years, even decades, of training. It too shall fall to AI.

customguy 3 hours ago

This Dust short, "The Greatest Lie" seems timely

https://www.youtube.com/watch?v=gulzQIkwbJg

(at least the intro.. all in all I think it's a bit too long and some part of it kinda "cringe", but hey)

jaybrendansmith 5 hours ago

Why downvote this? The Holy See has an opinion on Artificial Intelligence? This is a fascinating document, and everybody should read it, and form their own opinions. The world currently seems to lack moral leadership, and who better to lead the cause of humanity than the Catholic Church?

Ardren 4 hours ago

> who better to lead the cause of humanity than the Catholic Church?

Oh no, is my sarcasm meter broken?

bbor 2 hours ago

I'm glad he published it of course, but I was disappointed on two counts:

1. He's not at all careful with his argumentation. Frequently he'll colocate two points that aren't really connected, not bothering to justify one before moving on. I've been a massive fan of his persona ever since I heard he was planning to be the AI pope, but it's a shame to find the philosophical output of the actual man to be around the level of a decent blogger.

2. He refuses to make the Kantian or Hegelian move of basing the discussion of empirical matters on evidence. I understand that faith (aka 'belief without evidence') is a huge part of their whole deal--and likely an inextricable part of humanity's indomitable spirit--but it's just a waste of time to build arguments about technical and political matters upon such foundations.

In other words: there's no point in really talking about AI with someone willing to justify claims like 'no machine could ever think' with 'god says so'. All you can do is try to manipulate them into a prosocial position (read: your side).

Hopefully it's obvious that the majority of the letter isn't really about AI but rather about lessening the harms of capitalism, nationalism, and climate change, which hopefully we can all agree on! The commentary above is focused on the AI specific (esp. Chapter III and parts of I).

gymbeaux 42 minutes ago

Great message from the Pope (I never thought I'd write those words). I'm glad he recognizes what's going on with AI (LLMs, really) as one of the highest areas of concern for humanity and the Earth and is using his influence to encourage things like renewable energy investment. It's a shame he isn't in a position of "real" power and we're still at the mercy of the worst U.S. president in history.

One thing that isn't talked about enough is how so much is going into AI but not much is coming out of it. The rhetoric from tech bros is still that AI is "going to" change the world. Hasn't really changed the world yet, except driven up everyone's utility bills and put hundreds of thousands of people out of work.

I encourage people, especially software engineers here, to remember the previous "new hotness" tech advancements - blockchain and NoSQL DBs being two recent examples. In both instances there was a flood of VC money into startups that have mostly failed because each was supposed to change the world (or at least change software). I spent a lot of my free time in those days trying to "find a problem" for blockchain and NoSQL to solve. I remember thinking I must be a lousy software engineer because I just wasn't getting the hype. Now I know it's because whenever something new comes out, people talk about how it can do X Y and Z, and there's a disconnect between what a technology CAN do, and what it SHOULD do. I can use blockchain for all sorts of things, but in most cases it wouldn't be the best option. Same for NoSQL DBs. Same for LLMs. The more you understand blockchain, the more you realize it's only good as a globally-distributed, immutable ledger - and currency is the only practical application of that in our society today (e.g., Bitcoin). NoSQL is the same way - yeah you can use MongoDB for whatever app, but it's going to be a bad time maintaining and scaling when you're storing relatively simple and consistent records. A CRUD app usually doesn't warrant a NoSQL DB.

LLMs are the same. I'm finding they are good at search-type tasks, where frankly not much "thinking" is involved. Therefore, with respect to writing software, they are best suited for simple, internal tools. Even then, I have to baby it, especially with today's LLMs. Claude Opus has been nerfed (most-likely quantized) to make space in the datacenters for Mythos, and eventually Mythos will be bad too for the same reasons. The question becomes, as it always has, "will LLMs rise up to the challenge" and history tells us "no." These things never live up to the hype. When you understand how LLMs work, you understand why ChatGPT 3.5 isn't that much worse than GPT 5.5, artificial benchmarks be damned.

theletterf 5 hours ago

@dang Is this item getting a lot of negative votes? I've no way of knowing, other than seeing my kharma increasing only slightly after all the points the story collected.

vermilingua 5 hours ago

Votes (particularly on submissions over comments) do not directly translate to karma. I'm not sure if it's documented anywhere what the algorithm is, but it's something proportionate to the logarithm of post votes becomes profile karma. It's similar with comments, but I believe (anecdata and observation) the positive effect of votes on karma is also logarithmic, but the negative effects of downvotes is linear; so if you have a highly controversial comment that sits at 1-2 points, you can net lose account karma.

theletterf 3 hours ago

Thanks! That makes sense. This was just genuine curiosity on how HN works, I couldn't care less about kharma.

steveklabnik 2 hours ago

IAmGraydon 3 hours ago

So the guys at Anthropic convinced the Pope to write a hype piece for them. Next-level grifting right there.

451298 2 hours ago

Readers apparently think this comment is a joke. Not entirely:

https://religionnews.com/2026/05/22/why-anthropic-is-helping...

The vigilance the Pope calls for is appreciated, but never underestimate lobbying. If he had called for an outright AI moratorium or ban, that would be clear. But this encyclical leaves room for "adjustments", i.e., boiling the frog slowly.

the_real_cher 5 hours ago

Why does the onus fall on the engineer for creating a better tool and not on the people who use that tool in evil ways?

We've been having the same argument since the dawn of mankind. AI is the new AR.

sham1 2 hours ago

I'd say that the onus falls on the engineer insofar as they need to ask the questions of "why are we making the new better tool", "according to what criteria is it better", and "do we need the better tool". And at least for me, that onus falls on the engineer instead of falling on the user because it's the engineer who is creating the tool, not the user, and if the engineer chose differently, the tool wouldn't be out there to be used for evil.

Sometimes it might just be better to not do the thing, especially if it conflicts with one's morals. And well, the idea that "if I don't do this, someone else will" seems to not work out well in practice.

polotics 4 hours ago

What kind of regulation is Leo the alignment expert proposing exactly? Occam's Razor says this is Anthropic trying to build a regulatory moat by leveraging some halo effect.

Maybe Leo should focus on finding a way to disconnect western society from their current cult-of-progress delusions? Could be a better use of the infallible man's pulpit?

jeanlucas 4 hours ago

From what you read, what do you think? All your questions are mentioned in the encíclica.

polotics 4 hours ago

What kind of regulation is Leo the alignment expert proposing exactly?

Occam's Razor says this is Anthropic trying to build a regulatory moat by leveraging some halo effect.

Maybe Leo should focus on finding a way to disconnect western society from their current cult-of-progress delusions? Could be a better use of the infallible man's pulpit?

colinhb 3 hours ago

Attacking the cult of progress is a major through-line:

> 12: Today, the human desire for fullness of life is at risk of being misled by deceitful goals, such as the prospect of a technology that promises to free us from all weakness, and models of wellbeing that leave behind entire populations. All too often, we place our hope in unlimited 'upgrades,' in forms of progress that exacerbate inequalities, and in immediate solutions incapable of healing people's wounds.

> 94: The danger of humanity becoming a victim of its own achievements was already clearly recognized by Saint Paul VI, who warned that 'the most extraordinary scientific progress, the most astounding technical feats and the most amazing economic growth, unless accompanied by authentic moral and social progress, will in the long run go against man.' For this reason, technological progress — valuable in itself — requires careful discernment of the anthropological vision that guides it and the ends it pursues. If technological development advances without a corresponding ethical and social progress, the result may be an increase in means without a growth in humanity: 'having more' without 'being more.' In such a scenario, there is a risk that individuals will be evaluated principally according to the outcomes they produce.

> 112: More gravely, the pervasive technocratic paradigm in which we are immersed, and that is amplified by the digital revolution and AI, threatens to normalize an anti-human vision. In that vision, the fullness of life is equated with having more, reducing weakness, eliminating uncertainty and exerting total control. When efficiency becomes the ultimate measure of value, human beings are tempted to see themselves as a project to be optimized rather than as persons called to relationship and communion.

There's much more along these and related lines.

gchamonlive 3 hours ago

Although your comment is acid, I think this bears truth

> Maybe Leo should focus on finding a way to disconnect western society from their current cult-of-progress delusions?

It's too weak of a rhetoric from the highest representative of the Catholic church to call for regulations, but the alternative is to call for a transition from capitalism itself. Nothing that grows inside economic doctrines that only value constant growth at all costs can be safely regulated, regulation being only a makeshift solution.

bad_haircut72 2 hours ago

Capitalism is clearning having a moment atm but as far as I know nothing about capitalism demands permanent growth. Capitalism is about private ownership of the means of production (and a complicated system of laws that allow ownership of abstract concepts, like futures contracts). Its the people who always want more - usually the ones who already have the most, and this has been the case since the first kings.

hootz 2 hours ago

pocksuppet 2 hours ago

dist-epoch an hour ago

fgaanb 4 hours ago

The Pope is making a fundamental mistake here: His advisors told him that AI works and needs to be managed.

He does not address plagiarism, the fact that AI is mostly a surveillance and IP laundering tool, the fact that AI hasn't achieved much so far. You could say it has achieved nothing if compared to the whole history of human ingenuity, certainly not in CS.

He should have compared AI to the golden calf.

His criticism is lukewarm, does not address the criminal aspects and technological failures and is as such industry compliant. He can now say "I have tried" without harming the industry in the least.

This text is not what our current situation demands, but I hope that priests will augment and amplify it in their sermons and go a bit deeper.

dgellow 4 hours ago

Are people seriously turning towards their religions for a take on intellectual property rights?

fgaanb 4 hours ago

Technically it is one of the ten commandments.

dgellow 3 hours ago

b65e8bee43c2ed0 an hour ago

Impressive. Very nice.

Now let's see your views on homosexuality, promiscuity, contraception, abortion, drug use, and all the other things the target audience of this "I SUPPORT THE CURRENT THING" proclamation also feels strongly about.