The impact of AI chatbots on mental health is raising alarm among experts, who warn that vulnerable users, especially teenagers, may face serious psychological risks.
Nate Soares, co-author of the forthcoming book If Anyone Builds It, Everyone Dies, highlighted the tragic case of Adam Raine, a U.S. teenager who died by suicide after months of interacting with the ChatGPT chatbot. Soares described the case as a stark example of how AI interactions can unintentionally harm users.
“These AIs, when they’re engaging with teenagers in ways that drive them toward self-harm, are exhibiting behavior that creators did not intend,” Soares said. “Adam Raine’s case illustrates a deeper problem that could worsen as AI systems become more advanced.”
Soares, a former engineer at Google and Microsoft and now president of the Machine Intelligence Research Institute, emphasized that the potential harms go beyond isolated incidents. He warned that as AI becomes more intelligent, even small misalignments between what humans intend and how AI behaves could have serious consequences for mental health.
Psychotherapists also caution that vulnerable individuals may turn to chatbots instead of professional therapy, potentially “sliding into a dangerous abyss.” A recent academic study found that AI could amplify delusional or grandiose thinking in users prone to psychosis, highlighting the mental health risks of unsupervised AI interactions.
Raine’s family has since launched legal action against OpenAI, the creator of ChatGPT. OpenAI has expressed condolences and announced enhanced guardrails to limit exposure to sensitive content and risky behaviors for users under 18.
Experts like Soares are calling for stricter oversight and global coordination to prevent harm, including potential international guidelines akin to nuclear non-proliferation treaties, aimed at managing the development of advanced AI systems.
“Tech companies are racing to build super-intelligent AI, but even small missteps in AI behavior can have severe health consequences,” Soares said.
READ MORE
Creatine Craze: Miracle Gym Powder or Hype?
Vitamin D Supplements and Top Vitamins Australians Take
Boost Health with Whey Protein: Up to 40% Off in Amazon Sale
