Citing Gandalf, Pope Leo says we must "disarm" AI - Ars Technica
Skip to content
AI
Biz & IT
Cars
Culture
Gaming
Health
Policy
Science
Security
Space
Tech
Forum
Subscribe
Story text
Size
Small<br>Standard<br>Large
Width
Standard<br>Wide
Links
Standard<br>Orange
* Subscribers only
Learn more
Pin to story
Theme
Search
Sign In
Sign in dialog...
Text<br>settings
Story text
Size
Small<br>Standard<br>Large
Width
Standard<br>Wide
Links
Standard<br>Orange
* Subscribers only
Learn more
Minimize to nav
With the co-founder of Anthropic at his side today in Rome, Pope Leo XIV released a major new encyclical—his first—called “Magnifica Humanitas” (“Magnificent Humanity”). It calls for AI to be “disarmed” in service of the common good.
“The word is strong,” Leo admits, but he chose the language of “disarmament” deliberately “because this moment needs words capable of attracting attention, awakening consciences, and indicating paths forward for humanity.” AI today must be “freed from logics that turn it into an instrument of domination, exclusion, and death.”
The 40,000-word encyclical contains uncompromising critiques of AI-powered autonomous weapons, neo-colonial attitudes towards data collection, and the hoarding of “new forms of property, such as patents, algorithms, digital platforms, technological infrastructure, and data.”
But the letter goes far beyond critique, updating Catholic social teaching in a way that calls on everyone to “build”—a favorite term of the Silicon Valley elite. (See venture capitalist Marc Andreessen’s well-known 2020 essay, “It’s Time to Build.”)
In Leo’s vision, though, this “building” extends beyond code or startups or factories or housing. He calls for nothing less than the creation of a “civilization of love” in which everyone works for the common good within their own sphere of life and in which technology does not dominate, exclude, or bypass humanity, but instead serves and augments it.
That is why, despite releasing it today, Leo actually signed the encyclical on May 15, the anniversary of a famous 1891 encyclical called “Rerum Novarum” (“New Things”). That older document set out Catholic social teaching during an era of capitalist upheaval, largely taking the side of workers and labor unions. Today, Leo updates the church’s social teaching for the age of AI, which he sees as the “res novae of our time.”
That new thing
As his predecessor did 135 years ago, Leo warns that individual humans and humanity itself must not be left behind by technological advancements or by new forms of power. He is clear-eyed about the sway that technological elites hold today, comparing them to colonial conquerors.
Entire regions, especially those marked by structural fragility and limited geopolitical relevance, are currently subjected to a new mindset of extraction: that of health data, epidemiological profiles, genetic maps and demographic information. These have become the new “rare earths” of power: vital data which, once aggregated and analyzed, can be used to train predictive models, guide investment strategies, anticipate crises and, above all, determine who and what is deemed to matter.
Those who control the health data of entire peoples—often collected under the pretext of aid, research or innovation—possess a structural leverage over the future, for they can shape needs and markets. They can also decide, before others, to whom medicines, investments and protections will be allocated. Here lies one of the most urgent moral challenges of our time: to ensure that shared knowledge becomes a true common good rather than an instrument of dominance.
If we don’t figure this out, Leo says, “the digital age will not be post-colonial, but colonial in another form.”
Still, the Vatican is not opposed to AI as a tool. Indeed, this spring it rolled out an AI-powered system that will translate services at St. Peter’s into 60 languages on people’s smartphones.
But Magnifica Humanitas argues that AI must be kept in perspective, since “these systems merely imitate certain functions of human intelligence.” While they may be faster thinkers, AI tools “do not undergo experiences, do not possess a body, do not feel joy or pain, do not mature through relationships, and do not know from within what love, work, friendship, or responsibility mean. Nor do they have a moral conscience.”
That is why, Leo argues, we should not be led astray by AI’s focus on “intelligence.” Elevating one quality of the human person in this way can overshadow “other essential dimensions of life, such as affection, the will, commitment, and relationships.” If you give humans mere technical power apart from wisdom, emotion, and relationships, Leo says, it “does not make us more capable; it makes us more isolated and more vulnerable to being dominated and excluded.”
Because of this reality, AI must be “disarmed,” Leo concludes, freeing it “from monopolistic control and opening it to discussion and debate, therefore...