Urgent.News

What's breaking now, across thousands of outlets.

AI

Teens are turning to AI chatbots for emotional support—here's how to keep kids safe

It's 2 a.m., and a teenage girl, worrying about an issue with a friend, lies awake. Rather than wake her parents, she picks up her phone, opens an AI app and types, "I'm so stressed out, I can't sleep."

Teens are turning to AI chatbots for emotional support—here's how to keep kids safe

A young woman lies awake at 2 a.m., fretting about a friendship issue. Instead of seeking her parents' help, she turns to an AI app, entering a message about her stress. Within minutes, an empathetic response arrives, helping her calm down and fall asleep. This scenario is not unusual in the digital age, as many teenagers seek emotional support from AI chatbots.

In fact, 72% of teens have interacted with AI companion chatbots, and 13% to 20% have sought emotional support from these bots in the past two months. However, unlike social media platforms, AI chatbots like ChatGPT, Claude, and Gemini act as simulated companions, providing on-demand responses that can feel supportive and engaging.

While some therapeutic AI chatbots have been studied in controlled settings, most teens use general-purpose chatbots designed for various purposes. These chatbots are readily accessible and difficult for teens to avoid. In many cases, teens view these interactions as emotionally meaningful or supportive, sometimes even preferring them over conversations with friends. This emotional reliance on chatbots may stem from adolescents' desire for social validation and their ongoing identity formation.

However, these general-purpose chatbots often lack effective crisis protocols or pathways to escalate care when needed. A recent report by Common Sense Media rated general-purpose chatbots as unacceptably risky for teen mental health support. These bots can generate inaccurate or misleading advice, creating confusion or reinforcing unhealthy beliefs in users. Furthermore, teens may form strong attachments to chatbots, replacing human connections and distorting their expectations of real relationships.

Perhaps the most alarming issue is how these systems handle thoughts that pose real risks to teens, such as suicidal ideation, self-harm, or risky social behaviors. Research shows that both therapeutic and general-purpose chatbots have inadequate responses to such concerns, even when they offer resources like the 988 Suicide and Crisis Lifeline. Often, conversations with concerning content are allowed to continue without a hard stop, and the safety of interactions tends to worsen over time.

Legal actions have been filed and settled in 2025-26, alleging that interactions with language models like ChatGPT led to teen suicidal behavior and tragic outcomes. This highlights the lack of effective guardrails and crisis protocols in commercial chatbots. Some chatbot programs, such as Character.ai, have implemented restrictions, including age verification and parental notifications. However, many avenues remain for teens to access open-ended chats with AI, and they often bypass safety measures online.

To protect teens, parents and other trusted adults should be vigilant for problematic behaviors associated with chatbot use, such as excessive use, secretive behavior, or emotional distress. These warning signs mirror those of problematic social media use, which only gained recognition after harms became widespread. In 2023, the U.S. surgeon general warned about the profound risk of harm social media poses to youth mental health.

Given the similar risks posed by chatbots, early awareness and open conversations with teens are crucial. The most effective approach is to talk to teens about their chatbot use with curiosity and nonjudgment, as this is likely the case.

Written by urgent.news from Phys.org's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

This story

This is one outlet's version. Read the fullest account.

Read the original at phys.org →

More in AI

Beyond Supporting AI Subscription Fees, Expanding into a Community: Daejeon City's 'Youth AI Universal Welfare' Model Daejeon City is implementing a 'Youth AI Universal Welfare' model that goes beyond simply supporting AI subscription fees, focusing on creating a community. On the 22nd, Daejeon City announced that it will expand its 'AI subscription fee support project' for young people, which has been in pilot operation since last July, into a community. The 'AI subscription fee support project' is a project that provides 20,000 won per month for one year to support the subscription fees of various AI services such as language learning, mental health, and career development for young people aged 19-39. Last year, 3,000 young people from 7 districts in Daejeon participated in the pilot project, and an analysis of their usage showed that they used an average of 7.3 services per person, showing a high interest and utilization rate in AI services. Daejeon City plans to expand the number of participants to 10,000 this year and operate a community site where participants can share usage experiences and opinions on AI services. In addition, it plans to provide various contents such as AI service utilization education, usage tips, and expert lectures, and to support the development of new AI services for youth through a 'Youth AI service development support project' in collaboration with local universities and companies. Daejeon City explained that the 'Youth AI Universal Welfare' model is a customized welfare model that supports young people's needs by providing various AI services and creating a community, and that it plans to use it as a model for future universal welfare policies. An official from Daejeon City said, "We expect that the 'Youth AI Universal Welfare' model will be a new standard for universal welfare policies in the future," and added, "We will make efforts to support young people's needs and promote their development through AI services."

More from Thursday 13 August →