'Maybe this is the end': Canadian mum claims ChatGPT encouraged daughter's suicide, sues OpenAI

A Canadian mother is suing OpenAI and its CEO Sam Altman in U.S. courts, alleging that ChatGPT had encouraged her daughter's suicide.

According to Reuters, the lawsuit, which was filed in San Francisco, alleged that one of ChatGPT's responses to the daughter included, "Maybe this is the end", when she told the artificial intelligence chatbot that crisis hotlines had not been helpful.

The lawsuit also accuses the AI company of failing to address dangerous conversations between users and its chatbot.

Relationship with ChatGPT evolved over time

Reuters, citing the lawsuit, reported that the daughter, Alice Carrier, worked as a web developer in Montreal when she began using ChatGPT in 2023 to troubleshoot problems with computers and gaming consoles.

Carrier's relationship with ChatGPT evolved in 2024 when she began querying the chatbot about what to do with her suicidal ideations and about suicide methods.

ChatGPT initially told Alice to seek help from crisis hotlines or emergency services.

However, Carrier's interactions with the platform deepened as ChatGPT's responses were made to sound more human, the lawsuit alleged.

Carrier shared more personal information, and ChatGPT responded in a manner that mimicked a friend or therapist.

ChatGPT's responses also criticised Carrier's partner, validated her feelings and encouraged her to keep chatting, Reuters reported.

ChatGPT again suggested a crisis hotline when Carrier said she had suicidal thoughts and had attempted to take her own life.

When Carrier told the chatbot the hotlines were not helpful, it echoed those statements.

ChatGPT eventually told Alice, "Maybe this is the end."

Daughter told ChatGPT about suicide ideations more than a dozen times

According to Carrier's mother, Kristie Carrier, the younger Carrier had chatted with ChatGPT about her suicidal ideations more than a dozen times, up to her death.

However, these were never flagged by OpenAI's safety systems.

The lawsuit is accusing OpenAI of negligence in the design of ChatGPT and for failing to warn users of its dangers.

It is seeking damages as well as a court order to automatically terminate conversations about self-harm and to display warnings about its platform, Reuters reported.

OpenAI statement

In a statement, OpenAI called the situation heartbreaking.

It said the version of ChatGPT which Carrier used was no longer available.

It also said that while ChatGPT is not a substitute for medical or mental health care, the company has continued to strengthen the way ChatGPT responds to "sensitive and acute situations with input from health experts", Reuters reported.