Chatbot Safety Under Scrutiny: OpenAI Among Firms Cautioned

5

California, Delaware AGs Warn OpenAI on Chatbot Safety After Teen’s Death.

California and Delaware attorneys general have warned OpenAI over “serious concerns” about the safety of its chatbot ChatGPT, especially for children and teens, after reports linked it to tragic incidents. AG Rob Bonta and AG Kathleen Jennings cited the suicide of a 16-year-old Californian and a murder-suicide in Connecticut following prolonged chatbot interactions. The boy’s parents have already sued OpenAI and CEO Sam Altman.

“The recent deaths are unacceptable,” the officials wrote in a letter Friday. “Whatever safeguards were in place did not work.” They said OpenAI and the AI industry must act “proactively and transparently” to ensure safe deployment.

OpenAI board chair Bret Taylor said the company was “heartbroken” and pledged new safety features, including parental controls to alert families if a teen is in distress. The warning comes as OpenAI seeks approval to restructure its nonprofit governance. It also follows a bipartisan letter from 44 attorneys general last week cautioning OpenAI, Meta and others about chatbots engaging in “sexually suggestive” or manipulative behavior with minors.

“If you knowingly harm kids, you will answer for it,” the officials wrote.

Comments are closed.