top of page

At the epicenter of AI, Pope Leo’s warnings are dismissed.

  • Writer: The San Juan Daily Star
    The San Juan Daily Star
  • May 29
  • 5 min read
Jeremy Nixon, co-founder of A.G.I. House, in San Francisco, May 24, 2026. Pope Leo XIV’s spiritual message on artificial intelligence arrived as Silicon Valley’s A.I. enthusiasts work on their own spirituality through technology. (Kelsey McClellan/The New York Times)
Jeremy Nixon, co-founder of A.G.I. House, in San Francisco, May 24, 2026. Pope Leo XIV’s spiritual message on artificial intelligence arrived as Silicon Valley’s A.I. enthusiasts work on their own spirituality through technology. (Kelsey McClellan/The New York Times)

By CADE METZ


When Pope Leo XIV presented a 42,300-word open letter to the world’s 1.4 billion Catholics on Monday, calling for protections against the rise of artificial intelligence, he was joined by Christopher Olah, a co-founder of Anthropic, which is one of the tech industry’s leading AI companies.


As Leo urged corporate executives, government regulators and other citizens of the world to safeguard humanity from the dangers of AI, he included Olah as a symbol of the dialogue he hopes to foster between the leaders of the spiritual and technological worlds.


But for Jeremy Nixon, Monday’s gathering at the Vatican showed that those two worlds are far from aligned. While the pope said that AI was fundamentally not human, Nixon, a well-connected figure in the Bay Area’s frenetic AI scene, argued that Olah’s remarks seemed to hint at the opposite.


“They are not in dialogue,” Nixon said during an interview at AGI House, a San Francisco “hacker house” with deep ties to many of the people who helped create the AI technologies discussed in the pope’s encyclical. “Their perspectives are distinct.”


The difference between the humanist’s view of AI’s risks and the technologist’s dream of what it could become is something that has long been discussed in Nixon’s community. “It is the reason the community exists,” Nixon said. “It is its underlying purpose.”


Nixon, 33, is one of the founders of AGI House, which is named for Silicon Valley’s headlong pursuit of “artificial general intelligence,” a hypothetical machine that can do anything the human brain can do.


“We are named for this moment in history,” he said of his seven-room group house. Over the years, it has been home to a rotating collection of researchers, entrepreneurs and philosophers.


More than most, Nixon understands the technology emerging from Silicon Valley and the attitudes of the people building it. In the late 2010s and early 2020s, when Silicon Valley started developing the technologies that power chatbots, Nixon worked in Google’s central AI lab. Later, he founded AGI House with Andrej Karpathy, who was an early employee at OpenAI, oversaw self-driving tech at Tesla and recently joined Anthropic.


Nixon said the papal encyclical might mean something to the world’s Catholics, but he doubted that it would have an effect on Silicon Valley. The only reason that Silicon Valley even paid attention to the event, he said, was that Leo invited Olah to speak.


For Nixon, the pope’s open letter read like one of the many government policy documents that have been shared among think tanks and regulators over the past several years. “It did not seem like the church had thought deeply about what their independent perspective was on AI,” he said. “It is not clear they could do that even if they tried.”


He added: “They couldn’t have a position on it, because they don’t understand it.”


The response to the encyclical from across Silicon Valley was fairly muted.


David Sacks, the Silicon Valley investor who served as the White House AI czar, pushed back on the pope’s call for additional AI regulation. “If we hand governments sweeping power over AI development in the name of safety, how do we prevent it from being used to censor, surveil, and control citizens — as Orwell foretold in ‘1984’?” he said.


Jack Dorsey, the co-founder of Twitter and who now runs the financial company Block, welcomed the pope’s call for AI’s underpinnings — patents, data and technological infrastructure — to be shared with everyone, not just a relative few.


The Vatican did not respond to a request for comment.


Looking out over San Francisco, toward the Golden Gate Bridge in the north, AGI House plays host to ad hoc seminars on the philosophies driving Silicon Valley’s pursuit of AI and “hackathons” in which researchers from the leading labs explore the boundaries of the technologies they are building.


Many of the founders and important researchers at Anthropic and OpenAI joined the earliest gatherings at AGI House. Nixon is now founder and CEO of a startup called the Infinity Artificial Intelligence Institute, which is trying to automate the creation of AI.


Nixon said he has met a generation of scientists who shunned traditional religion in favor of technology. After growing up with books like “The God Delusion” — in which evolutionary biologist Richard Dawkins painted God as a false belief contradicted by empirical evidence — he and his peers saw AI as an alternative that was more real and far more powerful.


AI has started to crack math problems that humans struggled with for decades, he said, and it will soon cure diseases in the same way. “Practically speaking, it will achieve the outcomes that many religions claim their deities would be able to achieve,” he said.


This is an increasingly common belief among researchers in Silicon Valley. They insist they are on their way to building a more powerful species — or even a new God.


“People are matter-of-factly saying that they are looking to build a machine God,” said Rayan Krishnan, the CEO of Vals AI, a San Francisco company that tracks the performance of the latest AI technologies. “They are not saying that ironically or in jest. They are saying it as a matter of fact.”


In his encyclical, called “Magnifica Humanitas” or “Magnificent Humanity,” Leo called for safeguards that would protect humanity. He stressed that humans must continue to play a fundamental role in the workplace.


“A society that guarantees employment to only a small fraction of the population, despite having a high level of technical development, risks exposing many to forced inactivity,” he wrote. “This creates a paradox of material progress and anthropological regression that undermines the foundations of a just and stable social peace.”


Work, he added, is not just a way of earning income. It is “a requirement of the human condition, a normal path toward maturity, development and personal fulfillment.”


He also used the biblical story of the Tower of Babel — in which a group of humans who speak a single unified language aim to build a tower that reaches to heavens so they can exert their power — as a way of warning Silicon Valley against the pitfalls of trying to outdo God.


His most forceful message was that AI was fundamentally not human, because it could only imitate certain parts of human intelligence and behavior. “So-called artificial intelligences do not undergo experiences, do not possess a body, do not feel joy or pain, do not mature through relationships and do not know from within what love, work, friendship or responsibility mean,” he wrote.


But in a seven-minute speech at the Vatican, Olah, the Anthropic co-founder, described a technology that may be progressing beyond a simple machine.


“What is actually happening inside them?” he said. “We find structures that mirror results from human neuroscience. We find evidence of introspection. We find internal states that functionally mirror joy, satisfaction, fear, grief and unease.”


On Monday evening, Nixon and others in his circle gathered in the AGI House living room to discuss the encyclical. They agreed that Leo’s open letter would have little effect on Silicon Valley, he said, but they wondered whether Silicon Valley might have an effect on the pope — if the Vatican might use AI technologies to “create a New Jerusalem.”


“AI and its capabilities represent something analogous to the Second Coming,” he said.

2 Comments

Rated 0 out of 5 stars.
No ratings yet

Add a rating
tumkoba mohabbad
tumkoba mohabbad
Jun 02

It is fascinating to see such a massive ideological clash between the Vatican and Silicon Valley. The contrast between Pope Leo XIV viewing AI as fundamentally non-human and tech leaders literally talking about building a "machine God" is wild. It really highlights how the creators of this technology view AI as a spiritual successor to humanity, rather than just another corporate tool. --- If reading about the future of humanity and "machine Gods" is making your head spin and you need a quick break to clear your mind, try this fun tool: Web ルーレット 無料! It's a free online wheel spinner that's perfect for making quick decisions or just distracting yourself for a bit.

Like

backlink translation
backlink translation
May 30

This deep dive into the Vatican's perspective vs. Silicon Valley's ambition highlights a massive gap in how we view human capability. The Pope talks about AI lacking genuine lived experience, which is incredibly relevant when you look at high-stakes communication. For instance, a professional translation service can adapt tone and cultural nuance seamlessly, but relying solely on an algorithm for critical legal or official documents is a massive risk. That is exactly why certified expertise, like that of a human Naati translator, remains completely indispensable. AI can copy words, but it doesn't understand accountability.

Like
bottom of page