Anthropic Co-Founder Calls for Stronger AI Oversight Amidst Looming AI Job Displacement
In Focus
- Chris Olah said AI will displace people in jobs at a scale
- The Anthropic co-founder has interacted with over 15 religions over technology concerns
- AI firms work under commercial pressure that conflicts with societal interest
Anthropic co-founder Chris Olah has called for greater oversight on AI from governments, civil society, and religious leaders. According to Olah, the possibility of AI job displacement is very real and the technology should not be left entirely to tech companies. According to Olah, “supporting those displaced will be a moral imperative of historic proportions” once jobs are lost at scale.
Why is Stronger AI Oversight Needed?
Christopher Olah’s AI warning comes amidst rising ethical concerns that he claims extend beyond engineering. He noted that the concerns raised by the public, especially about young people and AI replacing human jobs, were understandable due to the speed at which the technology is developing.
“I think this is a scary moment. Things are moving fast. It’s a really powerful technology. There’s a risk that things could go badly, and it’s incumbent on all of us to push this in a good direction,” Olah stated as cited by Reuters.
Besides the impact of AI on employment, Olah said that artificial intelligence systems frequently display mysterious, often unsettling behaviour.
“We find structures that mirror results from human neuroscience. We find evidence of introspection, internal states that functionally mirror joy, satisfaction, fear, grief, and unease,” he noted.
He added that AI developers like Anthropic operate under intense commercial, geopolitical, and personal pressure, which can sometimes conflict with the broader interests of society.
“Every frontier AI lab operates inside a set of incentives and constraints that can sometimes conflict with doing the right thing,” he noted.
Why Did Anthropic Participate in the Vatican?
Olah discussed the impact of AI on the global workforce and other challenges posed by artificial intelligence during Pope Leo’s initial encyclical, an event that represents an unusual convergence between the technology sector and the Catholic Church.
Anthropic, which recently introduced the Mythos AI model, was the only big tech company that was invited to participate in the Vatican event. Olah noted that the decision on who to invite to the event was made by the Vatican. The Anthropic co-founder has spent most of his career making AI systems safer. For a long time, his engagement with religious communities has focused on AI safety and engagement.
Olah said that he had interacted with over 15 religions over technology concerns. The Anthropic founder appreciated the move by the Catholic Church to engage with the rapidly evolving technology. The AI lab participated in the Vatican soon after it acquired Stainless, the startup whose software is used by rival AI firms like Google and OpenAI.
Stainless is the software that makes AI usable by converting APIs into Software Development Kits (SDKs) across different programming languages.
How Has Anthropic Handled AI Safety in the Past?
Founded in 2021, Anthropic has developed Claude AI models and captured the interest of enterprise clients. Anthropic was founded by former OpenAI employees led by Dario Amodei and Chris Olah. The AI lab was founded amid concerns that the ChatGPT maker was advancing AI systems too quickly without sufficient safety testing.
Anthropic has also differed with President Donald Trump’s administration over AI policy. The contention with the government has revolved around safeguards that limit the military use of AI models, including autonomous weapons targeting and domestic surveillance applications.
