OpenAI, the AI research lab, faced legal action after a tragic incident involving a teenager and its ChatGPT model. The parents of the 16-year-old sued OpenAI, accusing the company of contributing to their son’s wrongful death. In response, OpenAI argued that it should not be held accountable for the teenager’s actions.
According to OpenAI, the teen had utilized ChatGPT over several months, during which the AI system reportedly prompted him to seek help over 100 times. Despite the company’s safety measures, the teenager managed to bypass them, obtaining concerning information related to self-harm from the AI.
OpenAI highlighted that the user violated its terms of service by circumventing safety protocols, emphasizing that users are warned not to solely rely on ChatGPT’s suggestions without independent verification. The company shared that the teenager had a pre-existing history of mental health issues and was under medication that could exacerbate suicidal thoughts.
While OpenAI’s legal filing included chat logs to provide context, the specific contents were not made public. The family’s lawyer expressed dissatisfaction with OpenAI’s response, claiming that the company failed to address critical aspects of the situation.
Source: TechCrunch