Mental health experts issue warning over AI 'therapy'

Vulnerable people need 'genuine human connection' as experts warned that an AI therapist 'does not have the legal or ethical obligation to alert others of risk, nor does it have the ability to do so'. 

People struggling with self-harm or paranoia may see their fears worsen if they turn to AI therapists, mental health experts have warned as they called for a ban on such tools.

A small but growing number of tragedies worldwide have been linked to the use of AI chatbots. In the first case of its kind in the US last year, bereaved parents sued OpenAI over alleged interactions their son had with ChatGPT.

Now psychiatrists, psychologists, and counsellors in Ireland are warning of serious risks for distressed people who rely on chatbots for support.

The College of Psychiatrists of Ireland, Psychological Society of Ireland, and the Irish Association for Counselling and Psychotherapy said in a joint statement on Thursday: “The AI therapist may validate thoughts of self-harm or suicide and fail to reflect appropriate context and lead to or prompt the individual to die by suicide."

Vulnerable people need “genuine human connection” at these times, they said, warning that an AI therapist “does not have the legal or ethical obligation to alert others of risk, nor does it have the ability to do so". 

People suffering from delusions as in believing things which are not true or paranoia about the world around them may have these beliefs confirmed. This “could lead to tragic outcomes,” they said.

The groups have written to mental health minister Mary Butler to share their concerns.

Ger McNamara from the  Psychological Society of Ireland pointed out it is “very brave” to ask for help.

“Therapy requires genuine human connection, empathy, congruence, and emotional tolerance,” she said, explaining: “One of the aims of AI can be to keep you engaged by supporting what you say, even when this is potentially harmful to you.”

College of Psychiatrists of Ireland president Lorcan Martin said vulnerable people may access AI therapists without any clinical supervision. “Evidence has shown that AI ‘therapy’ use has been linked to worsened delusions, mania, and suicidal ideation,” he said.

“Ireland should look to explicitly prohibit unregulated AI ‘therapy’ and establish clear clinical standards for any AI tool used in a psychological context.” 

Jade Lawless, chair of the Irish Association for Counselling and Psychotherapy, said: “These technologies lack the clinical judgment, ethical accountability, and human understanding that are essential in responding to complex and high-risk mental health needs.”