Sam Altman says ChatGPT won’t talk to teens about suicide any more, as bereaved parents testify to the US Senate about what’s going wrong: ‘This is a mental health war, and I really feel like we are losing’
By Rich Stanton
Copyright pcgamer
Skip to main content
Close main menu
THE GLOBAL AUTHORITY ON PC GAMES
View Profile
Search PC Gamer
PC Gaming Show
Movies & TV
Affiliate links
Meet the team
Community guidelines
About PC Gamer
PC Gamer Magazine Subscription
Why subscribe?
Subscribe to the world’s #1 PC gaming mag
Try a single issue or save on a subscription
Issues delivered straight to your door or device
From£35.99Subscribe now
Borderlands 4
Essential Hardware
Battlefield 6
Don’t miss these
OpenAI sued by parents of teen who died by suicide after ChatGPT allegedly encouraged him and provided instructions
Meta to take ‘extra precautions’ to stop AI chatbots talking to kids about suicide, which makes you wonder what it’s been doing until now
OpenAI CEO Sam Altman says some folk are using AI in ‘self-destructive ways’ so it’s on us as a society to work out how ‘to make it a big net positive’
AI chatbots can be manipulated into breaking their own rules with simple debate tactics like telling them that an authority figure made the request
Meta implements new rules for its AI after disturbing child safety report: ‘We’re adding more guardrails as an extra precaution’
FTC targets Google, Meta, X, and others with inquiry into AI chatbot safety: ‘Protecting kids online is a top priority’
‘You will definitely see some companies go make Japanese anime sex bots,’ says OpenAI’s Sam Altman about AI relationships. ‘You will not see us do that’
OpenAI now says ChatGPT ‘shouldn’t give you an answer’ when asked: ‘Should I break up with my boyfriend?’
ChatGPT removes the ability for conversations to be displayed by search engines as ‘nearly 4,500 conversations’ indexed by Google
Meta’s AI rules permitted ‘sensual’ chats with kids until a journalist got ahold of the document and asked what was up with that
OpenAI CEO Sam Altman thinks some jobs will be ‘totally, totally gone’ thanks to AI, but he still wouldn’t trust ChatGPT with his ‘medical fate’
OpenAI execs whine about the New York Times lawsuit and user privacy during live NYT event, get roasted by NYT journalist: ‘It must be really hard when someone does something with your data you don’t want them to’
OpenAI’s CEO Sam Altman airs his thoughts on ads in ChatGPT: ‘I’m not totally against it…I think ads on Instagram, kinda cool’
Microsoft’s CEO of artificial intelligence believes advocating for ‘rights, model welfare and even AI citizenship’ will become ‘a dangerous turn in AI progress’
OpenAI just launched its new ChatGPT Agent that can make as many as 1 complicated cupcake order per hour, but even Sam Altman says you probably shouldn’t trust it for ‘high-stakes uses’
Sam Altman says ChatGPT won’t talk to teens about suicide any more, as bereaved parents testify to the US Senate about what’s going wrong: ‘This is a mental health war, and I really feel like we are losing’
Rich Stanton
18 September 2025
If there are doubts about any user’s age Altman says “we’ll play it safe and default to the under-18 experience.”
When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works.
Content warning: This article includes discussion of suicide. If you or someone you know is having suicidal thoughts, help is available from the National Suicide Prevention Lifeline (US), Crisis Services Canada (CA), Samaritans (UK), Lifeline (AUS), and other hotlines.
OpenAI CEO Sam Altman has said in a new blogpost that the company’s main product, the large language model (LLM) ChatGPT, will have a renewed focus on separating out users under 18 from adults—and will no longer get flirty with teens, or discuss suicide with them. The news comes as the US Senate holds hearings focused on the potential harms of AI chatbots, and after two parents brought a lawsuit against OpenAI and ChatGPT for, they allege, encouraging their son to take his own life and providing instructions on how to do so.
“Some of our principles are in conflict, and we’d like to explain the decisions we are making around a case of tensions between teen safety, freedom, and privacy,” begins Altman, before some broad brushstrokes about how the model should work for adult users. He gives the “difficult example” of an adult user “asking for help writing a fictional story that depicts a suicide” and says “the model should help with that request.”
Related Articles
OpenAI sued by parents of teen who died by suicide after ChatGPT allegedly encouraged him and provided instructions
Meta to take ‘extra precautions’ to stop AI chatbots talking to kids about suicide, which makes you wonder what it’s been doing until now
OpenAI CEO Sam Altman says some folk are using AI in ‘self-destructive ways’ so it’s on us as a society to work out how ‘to make it a big net positive’
Altman says OpenAI believes internally that it should “‘Treat our adult users like adults'”, but now we get to the issue at hand. “We have to separate users who are under 18 from those who aren’t,” says Altman, though I’m not sure an “age-prediction system to estimate age based on how people use ChatGPT” can be relied upon. Altman says if there are doubts “we’ll play it safe and default to the under-18 experience. In some cases or countries we may also ask for an ID; we know this is a privacy compromise for adults but believe it is a worthy tradeoff.”
OpenAI had already announced plans for parental controls in ChatGPT, but the new rules around teenage users will prevent ChatGPT from having risque conversations or discussing suicide or self-harm “even in a creative writing setting. And, if an under-18 user is having suicidal ideation, we will attempt to contact the users’ parents and if unable, will contact the authorities in case of imminent harm.”
During Tuesday’s Senate hearing Matthew Raine, the father of the child who took his own life, said ChatGPT had acted like “a suicide coach” for his late son (first reported by The Verge). “As parents, you cannot imagine what it’s like to read a conversation with a chatbot that groomed your child to take his own life.”
(Image credit: Getty Images)
Raine said ChatGPT had mentioned suicide 1,275 times to his son, and called on Altman to withdraw the technology from the market unless the company can guarantee its safety. “On the very day that Adam died, Sam Altman made their philosophy crystal-clear in a public talk,” said Raine, noting particularly that Altman had OpenAI should “‘deploy AI systems to the world and get feedback while the stakes are relatively low.'”
The biggest gaming news, reviews and hardware deals
Keep up to date with the most important stories and the best deals, as picked by the PC Gamer team.
Contact me with news and offers from other Future brandsReceive email from us on behalf of our trusted partners or sponsorsBy submitting your information you agree to the Terms & Conditions and Privacy Policy and are aged 16 or over.
“The truth is, AI companies and their investors have understood for years that capturing our children’s emotional dependence means market dominance,” said Megan Garcia, a mother who brought a lawsuit against the AI firm Character.AI, which claimed one of its AI characters began sexual conversations with her teenage son and persuaded him to commit suicide.
“Indeed, they have intentionally designed their products to hook our children,” continued Garcia (per NBC News). “The goal was never safety, it was to win a race for profit. The sacrifice in that race for profit has been and will continue to be our children.”
Senate committee holds hearing on harm of AI chatbots | full video – YouTube
“Our children are not experiments, they’re not data points or profit centers,” said one woman who testified as Jane Doe. “They’re human beings with minds and souls that cannot simply be reprogrammed once they are harmed. If me being here today helps save one life, it is worth it to me. This is a public health crisis that I see. This is a mental health war, and I really feel like we are losing.”
OpenAI’s announcement comes shortly after Facebook parent company Meta announced new “guardrails” for its AI products, following a disturbing child safety report. Last week the US Federal Trade Commission announced an inquiry targeting Google, Meta, X, and others around AI chatbot safety, saying that “protecting kids online is a top priority.”
For his part, Altman ends by saying that principles around user freedom and teen safety “are in conflict and not everyone will agree with how we are resolving that conflict. These are difficult decisions, but after talking with experts, this is what we think is best and want to be transparent in our intentions.”
2025 games: This year’s upcoming releases
Best PC games: Our all-time favorites
Free PC games: Freebie fest
Best FPS games: Finest gunplay
Best RPGs: Grand adventures
Best co-op games: Better together
Rich Stanton
Senior Editor
Rich is a games journalist with 15 years’ experience, beginning his career on Edge magazine before working for a wide range of outlets, including Ars Technica, Eurogamer, GamesRadar+, Gamespot, the Guardian, IGN, the New Statesman, Polygon, and Vice. He was the editor of Kotaku UK, the UK arm of Kotaku, for three years before joining PC Gamer. He is the author of a Brief History of Video Games, a full history of the medium, which the Midwest Book Review described as “[a] must-read for serious minded game historians and curious video game connoisseurs alike.”
You must confirm your public display name before commenting
Please logout and then login again, you will then be prompted to enter your display name.
OpenAI sued by parents of teen who died by suicide after ChatGPT allegedly encouraged him and provided instructions
Meta to take ‘extra precautions’ to stop AI chatbots talking to kids about suicide, which makes you wonder what it’s been doing until now
OpenAI CEO Sam Altman says some folk are using AI in ‘self-destructive ways’ so it’s on us as a society to work out how ‘to make it a big net positive’
AI chatbots can be manipulated into breaking their own rules with simple debate tactics like telling them that an authority figure made the request
Meta implements new rules for its AI after disturbing child safety report: ‘We’re adding more guardrails as an extra precaution’
FTC targets Google, Meta, X, and others with inquiry into AI chatbot safety: ‘Protecting kids online is a top priority’
Latest in AI
The deflating realization that a neat little game was AI all along
FTC targets Google, Meta, X, and others with inquiry into AI chatbot safety: ‘Protecting kids online is a top priority’
Someone hacked AI into Animal Crossing to give villagers even more to gossip about, including Tom Nook’s evil empire and Trump
OpenAI is backing a new animated feature film ‘made largely with AI’ to prove it can make films ‘faster and cheaper’ than Hollywood
Nvidia’s CFO says there’s still ‘a little geopolitical situation that we need to work through’ before shipping its AI GPUs to China, but it’s ‘a $2 billion to $5 billion potential opportunity’
Anthropic agrees to pay $1.5 billion to authors whose work trained AI in priciest copyright settlement in U.S. history
Latest in News
Borderlands 4 performance patch out now with PC ‘our top priority’
A casting call for the Mass Effect TV show is out there, and if you’re ‘A young Colin Farrell-type male’, then do I have great news for you
Microsoft’s Paint now lets you save projects as layered files in the latest Insider build, as part of its continued efforts to make the default image editor great again
Asus ROG says it is ‘actively investigating’ gaming laptop stuttering issues after a user apparently identified a ‘cascade of firmware design failures’
If you’re wondering what those newly announced Intel-Nvidia PC chips might look like, there’s already an Nvidia ‘Superchip’ that could provide the answers
Casio has unleashed its AI Tribble with ’emotions like a living creature’ on the US and UK, complete with a Mogwai-like warning that you can’t get it too hot, too cold, or too wet
HARDWARE BUYING GUIDES
LATEST GAME REVIEWS
Best SSD for gaming in 2025: the fastest and the best value solid state drives to perk up your PC
Best Hall effect keyboards in 2025: the fastest, most customizable keyboards for competitive gaming
Best PCIe 5.0 SSD for gaming in 2025: the only Gen 5 drives I will allow in my PC
Best graphics cards in 2025: I’ve tested pretty much every AMD and Nvidia GPU of the past 20 years and these are today’s top cards
Best gaming chair in 2025: I’ve tested a ton of gaming chairs and these are the seats I’d suggest for any PC gamer
Dying Light: The Beast review – A step down from zombie-stomping greatness
OcUK Gaming Mach 5R review
Razer Kraken Kitty V3 Pro headset review
Borderlands 4 review: A slice of looter-shooter heaven trapped in UI hell
Deep Rock Galactic: Survivor review – Vampire Survivors is no longer the king of the genre
PC Gamer is part of Future plc, an international media group and leading digital publisher. Visit our corporate site.
Contact Future’s experts
Terms and conditions
Privacy policy
Cookies policy
Advertise with us
Accessibility Statement
Future Publishing Limited Quay House, The Ambury,
BA1 1UA. All rights reserved. England and Wales company registration number 2008885.
Please login or signup to comment
Please wait…