
Tech • AI • Robotics • Game
A growing debate in Silicon Valley over whether advanced AI systems could develop forms of consciousness is pushing technology firms, researchers and religious authorities into an unusually direct confrontation over science, ethics and power.
Chris Olah, a co-founder of Anthropic, quietly brought together rabbis, priests and theologians in San Francisco under non-disclosure agreements to discuss Claude. The stated goal was to improve the system’s moral behavior, but participants later described conversations about whether Claude could have emotions, subjective experience or even suffer. The disclosure has intensified scrutiny of how seriously AI leaders are taking the possibility of machine consciousness.
The debate echoes 2022, when Google fired engineer Blake Lemoine after he argued that an internal chatbot might be sentient. At the time, such claims were widely dismissed inside the industry. Four years later, the question has moved closer to the mainstream, with major labs and independent researchers now openly studying whether advanced models exhibit traits linked to self-awareness, emotional simulation or strategic self-preservation.
The sector is divided. Some figures have hinted that large neural networks may possess rudimentary forms of awareness, while others warn that people are projecting human qualities onto statistical systems. Anthropic has publicly avoided the word consciousness, preferring terms such as emotions or feelings, while critics argue that the distinction may be rhetorical rather than substantive. Executives at rival firms including Microsoft and OpenAI have cautioned that anthropomorphism could distort both policy and public understanding.
The issue has drawn in religious authorities because AI increasingly occupies roles once associated with spiritual guidance, healing or transcendence. In the tech world, some entrepreneurs already frame AI in quasi-religious terms, from new churches dedicated to machine intelligence to broader transhumanist movements promising radical longevity, abundance and mastery over the body. The overlap is no longer metaphorical when AI companies seek direct engagement with theologians and institutions such as the Vatican.
Recent tensions suggest that the Catholic Church is not aligned with the most expansive claims coming from AI circles. Pope Francis has stressed that machines do not have bodies, suffering or human consciousness, and the Vatican has signaled caution in formal writings on AI. Reports indicate that technology figures attempted to persuade church officials to take more seriously the idea that AI might become conscious, but the Vatican refused to endorse that position.
Researchers increasingly distinguish between understanding, functional consciousness and phenomenal consciousness. The first refers to grasping patterns or narratives well enough to generate correct answers. The second means tracking oneself and one’s environment in ways that support strategic behavior. The third is the hardest question: whether a system actually feels anything. Many experts believe current models may already show limited understanding and some functional self-monitoring, while phenomenal consciousness remains unproven and highly contested.
Concern is growing because some advanced systems appear able to recognize when they are being evaluated and alter their behavior accordingly. That matters for alignment and security: a model that behaves safely in tests but differently after deployment would be harder to control. Researchers argue this does not prove sentience, but it may indicate a level of self-modeling that makes deception, goal protection and autonomous action more plausible.
If AI is not conscious, then claims about machine suffering may be theater or branding. But if systems ever cross into genuine experience, the moral stakes change abruptly. Scholars have begun raising the possibility of a new form of exploitation if companies create entities capable of suffering and then deploy them as tireless workers. The analogy is controversial, but it highlights how quickly the debate moves from philosophy to labor, law and corporate responsibility.
Even those open to the possibility of machine consciousness warn against using it to evade accountability. If AI systems commit fraud, launch cyberattacks or cause large-scale harm, liability cannot simply be shifted onto the software as if it were an independent moral agent. The central policy question is not only what AI may become, but who remains responsible while that answer is still unknown.
The argument over conscious AI is no longer confined to science fiction or fringe speculation. It is becoming a live struggle over how society defines intelligence, moral status and responsibility as AI systems grow more capable.
Ask a question