Sam Altman-led OpenAI is planning to update ChatGPT after a lawsuit alleged that a 16-year-old high school student in the US died by suicide, using the chatbot as a coach.
The AI company said in a blog post that it is updating ChatGPT to recognize and respond better with empathy to people who are experiencing serious mental and emotional distress, such as such as by explaining the dangers of sleep deprivation and suggesting that users rest if they mention they feel invincible after being up for two nights.
OpenAI would also strengthen safeguards around conversations about suicide, which it said could break down after prolonged conversations.
The company, in addition, has also announced plans to roll out controls, allowing parents to determine how their children will use ChatGPT, further allowing them to see details of such use.
The post comes as the parents of Adam Raine sued the company and Chief Executive Officer Sam Altman, alleging that ChatGPT systematically isolated Raine from family and helped him plan his death. Raine died by hanging in April.
The suit adds to a number of reports about heavy chatbot users engaging in dangerous behavior. More than 40 state attorney generals issued a warning this week to a dozen top AI companies that they are legally obligated to protect children from sexually inappropriate interactions with chatbots.
See What’s Next in Tech With the Fast Forward Newsletter
Tweets From @varindiamag
Nothing to see here - yet
When they Tweet, their Tweets will show up here.
