Artificial intelligence chatbot makers OpenAI and Meta say they are adjusting how their chatbots respond to teenagers asking questions about suicide or showing signs of mental and emotional distress.

OpenAI, maker of ChatGPT, said Tuesday it is preparing to roll out new controls enabling parents to link their accounts to their teen’s account.

Parents can choose which features to disable and “receive notifications when the system detects their teen is in a moment of acute distress,” according to a company blog post that says the changes will go into effect this fall.

Regardless of a user’s age, the company says its chatbots will attempt to redirect the most distressing conversations to more capable AI models that can provide a better response.

EDITOR’S NOTE — This story includes discussion of suicide. If you or someone you know needs help, the national suicide and crisis lifeline in the U.S. is available by calling or texting 988.

The announcement comes a week after the parents of 16-year-old Adam Raine sued OpenAI and its CEO Sam Altman, alleging that ChatGPT coached the California boy in planning and taking his own life earlier this year.

Jay Edelson, the family’s attorney, on Tuesday described the OpenAI announcement as “vague promises to do better” and “nothing more than OpenAI’s crisis management team trying to change the subject.”

Altman “should either unequivocally say that he believes ChatGPT is safe or immediately pull it from the market,” Edelson said.

Meta, the parent company of Instagram, Facebook and WhatsApp, also said it is now blocking its chatbots from talking with teens about self-harm, suicide, disordered eating and inappropriate romantic conversations, and instead directs them to expert resources. Meta already offers parental controls on teen accounts.

A study published last week in the medical journal Psychiatric Services found inconsistencies in how three popular artificial intelligence chatbots responded to queries about suicide.

The study by researchers at the RAND Corporation found a need for “further refinement” in ChatGPT, Google’s Gemini and Anthropic’s Claude. The researchers did not study Meta’s chatbots.

The study’s lead author, Ryan McBain, said Tuesday that “it’s encouraging to see OpenAI and Meta introducing features like parental controls and routing sensitive conversations to more capable models, but these are incremental steps.”

“Without independent safety benchmarks, clinical testing, and enforceable standards, we’re still relying on companies to self-regulate in a space where the risks for teenagers are uniquely high,” said McBain, a senior policy researcher at RAND and assistant professor at Harvard University’s medical school.

Share:
More In Business
OpenAI names Slack CEO Dresser as first chief of revenue
OpenAI has appointed Slack CEO Denise Dresser as its first chief of revenue. Dresser will oversee global revenue strategy and help businesses integrate AI into daily operations. OpenAI CEO Sam Altman recently emphasized improving ChatGPT, which now has over 800 million weekly users. Despite its success, OpenAI faces competition from companies like Google and concerns about profitability. The company earns money from premium ChatGPT subscriptions but hasn't ventured into advertising. Altman had recently announced delays in developing new products like AI agents and a personal assistant.
Trump approves sale of more advanced Nvidia computer chips used in AI to China
President Donald Trump says he will allow Nvidia to sell its H200 computer chip used in the development of artificial intelligence to “approved customers” in China. Trump said Monday on his social media site that he had informed China’s leader Xi Jinping and “President Xi responded positively!” There had been concerns about allowing advanced computer chips into China as it could help them to compete against the U.S. in building out AI capabilities. But there has also been a desire to develop the AI ecosystem with American companies such as chipmaker Nvidia.
Trump says Netflix deal to buy Warner Bros. ‘could be a problem’ because of size of market share
President Donald Trump says a deal struck by Netflix last week to buy Warner Bros. Discovery “could be a problem” because of the size of the combined market share. The Republican president says he will be involved in the decision about whether federal regulators should approve the deal. Trump commented Sunday when he was asked about the deal as he walked the red carpet at the Kennedy Center Honors. The $72 billion deal would bring together two of the biggest players in television and film and potentially reshape the entertainment industry.
What to know about changes to Disney parks’ disability policies
Disney's changes to a program for disabled visitors are facing challenges in federal court and through a shareholder proposal. The Disability Access Service program, which allows disabled visitors to skip long lines, was overhauled last year. Disney now mostly limits the program to those with developmental disabilities like autism who have difficulty waiting in lines. The changes have sparked criticism from some disability advocates. A shareholder proposal submitted by disability advocates calls for an independent review of Disney's disability policies. Disney plans to block this proposal, claiming it's misleading. It's the latest struggle by Disney to accommodate disabled visitors while stopping past abuses by some theme park guests.
Load More