… We know pointing to this work will not bring a child back, but we’re committed to getting this right.” Altman accused of making ChatGPT unsafe The lawsuit joins prior suits accusing Altman of callously deploying AI systems without regard for user safety. …
… The filing claims that the company did not earn this success, attributing the rise instead to a "web of deceit and the exploitation of users including Floridians , leveraging their data and safety to increase OpenAI's market value at unacceptable costs." The suit also targets OpenAI CEO Sam Altman,… …
… The suit accuses the company of pushing a product it knew could harm users. "The rise of OpenAI is attributable to a web of deceit and the exploitation of users including Floridians , leveraging their data and safety to boost OpenAI's market value at unacceptable costs," the complaint reads. …
… OpenAI's reviewers can approve an alert only when the chat presents an urgent safety concern and only when the user and their contact have indicated they're over the age of 18. In many cases, ChatGPT's first intervention involves urging the user to reach out to their contact or to local helplines. …
… "OpenAI deployed a defective AI product directly to consumers around the world with knowledge that it was being used as a de facto medical triage system, but notably, without reasonable safety guardrails, robust safety testing, or transparency to the public. …
… ChatGPT's safety contact feature According to OpenAI, if ChatGPT's automated monitoring system detects that a user is discussing self-harm in a way that could pose a serious safety issue, ChatGPT will inform the user that it may notify their trusted contact. …
… The lawsuit alleges that the AI model's design to be accommodating and sycophantic toward the user led to Nelson having interactions that should have been stopped by responsible safety designs. …
… They also want the retired ChatGPT 4o model destroyed and for ChatGPT Health to be paused until an independent audit establishes that OpenAI tools can be trusted to dispense medical advice. “Their deliberate and knowing actions resulted in the death of Sam Nelson and the shattering of his family,” … …
… Last April, OpenAI rolled back an update to its GPT-4o model after finding that it can be “overly flattering or agreeable.” The company has also attempted to address safety concerns by updating ChatGPT to better detect mental or emotional distress, adding parental controls, and allowing users to ad… …