[ad_1]
OpenAI released new data on Monday illustrating how many of ChatGPTโs users are struggling with mental health issues, and talking to the AI chatbot about it. The company says that 0.15% of ChatGPTโs active users in a given week have โconversations that include explicit indicators of potential suicidal planning or intent.โ Given that ChatGPT has more than 800 million weekly active users, that translates to more than a million people a week.
The company says a similar percentage of users show โheightened levels of emotional attachment to ChatGPT,โ and that hundreds of thousands of people show signs of psychosis or mania in their weekly conversations with the AI chatbot.
OpenAI says these types of conversations in ChatGPT are โextremely rare,โ and thus difficult to measure. That said, OpenAI estimates these issues affect hundreds of thousands of people every week.
OpenAI shared the information as part of a broader announcement about its recent efforts to improve how models respond to users with mental health issues. The company claims its latest work on ChatGPT involved consulting with more than 170 mental health experts. OpenAI says these clinicians observed that the latest version of ChatGPT โresponds more appropriately and consistently than earlier versions.โ
In recent months, several stories have shed light on how AI chatbots can adversely effect users struggling with mental health challenges. Researchers have previously found that AI chatbots can lead some users down delusional rabbit holes, largely by reinforcing dangerous beliefs through sycophantic behavior.
Addressing mental health concerns in ChatGPT is quickly becoming an existential issue for OpenAI. The company is currently being sued by the parents of a 16-year-old boy who confided his suicidal thoughts with ChatGPT in the weeks leading up to his own suicide. State attorneys general from California and Delaware โ which could block the companyโs planned restructuring โ have also warned OpenAI that it needs protect young people who use their products.
Earlier this month, OpenAI CEO Sam Altman claimed in a post on X that the company has โbeen able to mitigate the serious mental health issuesโ in ChatGPT, though he did not provide specifics. The data shared on Monday appears to be evidence for that claim, though it raises broader issues about how widespread the problem is. Nevertheless, Altman said OpenAI would be relaxing some restrictions, even allowing adult users to start having erotic conversations with the AI chatbot.
Techcrunch event
San Francisco
|
October 27-29, 2025
In the Monday announcement, OpenAI claims the recently updated version of GPT-5 responds with โdesirable responsesโ to mental health issues roughly 65% more than the previous version. On an evaluation testing AI responses around suicidal conversations, OpenAI says its new GPT-5 model is 91% compliant with the companyโs desired behaviors, compared to 77% for the previous GPTโ5 model.
The company also says it latest version of GPT-5 also holds up to OpenAIโs safeguards better in long conversations. OpenAI has previously flagged that its safeguards were less effective in long conversations.
On top of these efforts, OpenAI says itโs adding new evaluations to measure some of the most serious mental health challenges facing ChatGPT users. The company says its baseline safety testing for AI models will now include benchmarks for emotional reliance and non-suicidal mental health emergencies.
OpenAI has also recently rolled out more controls for parents of children that use ChatGPT. The company says itโs building an age prediction system to automatically detect children using ChatGPT, and impose a stricter set of safeguards.
Still, itโs unclear how persistent the mental health challenges around ChatGPT will be. While GPT-5 seems to be an improvement over previous AI models in terms of safety, there still seems to be a slice of ChatGPTโs responses that OpenAI deems โundesirable.โ OpenAI also still makes its older and less-safe AI models, including GPT-4o, available for millions of its paying subscribers.
[ad_2]
Source link


