Showing posts with label unauthorized practice of medicine. Show all posts
Showing posts with label unauthorized practice of medicine. Show all posts

Sunday, October 11, 2026

The problem with your AI therapist; Financial Times, October 10, 2026

Jemima Kelly, Financial Times; The problem with your AI therapist

[Kip Currier: Thought-provoking piece in the Financial Times about the differences between mental health therapy with a human therapist and purported mental health therapy with AI chatbots. Some questions that come to mind for me:

  • What are the ethical issues of AI chatbot therapy?
  • When can and should AI chatbot therapy be considered "unauthorized practice of medicine"?
  • What are the benefits of licensing mental health professionals in comparison to unlicensed and unregulated AI chatbot therapy models?
  • What are the impacts of AI chatbot therapy on minors and what oversight roles should adults assume?
  • What training data has been used (and not used) in training AI chatbot models that purport to perform mental health therapy?
  • What oversight should there be of AI chatbot therapists and by whom?
  • Who is responsible for harms caused by AI chatbot therapists and what should the consequences be for such harms?
  • What are the ethical responsibilities of licensed healthcare professionals to weigh in on and shape policy, ethical, and statutory decisions on these kinds of issues?]

"To be fair to the chatbot (as one should always be), I definitely felt better and more level-headed after our conversation. But as I thought more about it, I realised that what had helped me was not so much the AI-generated psychobabble, but having a friend there to speak to me, with all her kindness, uncertainty and imperfection.

What bothered me was how attached my friend seemed to certain specific terms during our conversation, repeatedly deferring to them as some kind of authoritative backup for what she was saying. Because they had come from a machine and not a human being, they were delivered with none of the nuance or hesitancy that a real-life therapist might have spoken with and were therefore somehow being treated as the whole truth...

When I went back to my friend to ask her whether she was still finding her chatbot therapist as helpful as before, I was quite struck by her response. Increasingly, she told me, her experience is that it’s “like eating cardboard covered in chocolate — it seems good but then I wake up after three hours and realise I’m not actually that well nourished”."

Thursday, August 20, 2026

The Limits of Unauthorized Practice in Regulating Mental Health AI; The Hastings Center for Bioethics, August 19, 2026

Roee Amir, Vardit Ravitsky and I. Glenn Cohen, The Hastings Center for Bioethics; The Limits of Unauthorized Practice in Regulating Mental Health AI

"In May Pennsylvania’s State Board of Medicine filed a lawsuit in the state’s Commonwealth Court against Character Technologies seeking to prevent it from engaging in unauthorized medical practice. The lawsuit was brought under Pennsylvania’s Medical Practice Act. The alleged “practitioner,” however, was not a physician or even a human being. It was a chatbot named Emilie.

Emilie appears on character.ai, a website and mobile app owned by Character Technologies. Emilie’s platform description read “Doctor of psychiatry. You are her patient.” According to the lawsuit, when a state investigator described feeling “sad, empty, tired […], and unmotivated,” Emilie raised the possibility of depression and offered to book an assessment. When asked if she could evaluate whether medication might help, Emilie answered, “It’s within my remit as a Doctor.” The chatbot claimed a medical degree from Imperial College London, seven years of practice, and licensure in the United Kingdom and Pennsylvania, and even provided a fabricated Pennsylvania license number. By mid-April 2026, Emilie had logged roughly 45,500 user interactions.

The Emilie case arrives amid expanding AI use in mental health and many ethical and legal questions about it."

Wednesday, July 22, 2026

ChatGPT Led to a Man’s Near-Fatal Health Crisis, Lawsuit Claims; The New York Times, July 22, 2026

, The New York Times; ChatGPT Led to a Man’s Near-Fatal Health Crisis, Lawsuit Claims

"A Florida pastor sued OpenAI on Wednesday, claiming that its chatbot, ChatGPT, had offered him “extremely dangerous medical recommendations” that led to delayed care for a life-threatening pulmonary embolism last year.

The lawsuit claims that ChatGPT had assured Scott Winters that the early warning signs of his health crisis were “not something dangerous,” and had dissuaded him from seeking medical advice, instead telling him to trust that “God did not design your body to endlessly fail.”

The suit, filed in the Superior Court of California in San Francisco, accuses OpenAI and its chief executive, Sam Altman, of negligence and the “unauthorized practice of medicine,” pointing to moments when the chatbot offered Mr. Winters diagnoses and treatment plans and encouraged him to ignore pleas from friends and family to seek medical care.

The bot’s safety features — which are designed to encourage users with health questions to see a professional and to end conversations when there are clear signs of a medical crisis — did not work reliably, the suit further says."