OpenAI has teen-friendly ChatGPT responding to instances of self-harm and suicide linked to chatbots

For a generation of digital natives, Artificial Intelligence (AI) is no longer a concept of the future. It has seamlessly integrated into their daily lives, serving as a sounding board for curiosity, a companion in learning, communication, and emotional support. Consequently, the launch of OpenAI’s ChatGPT for teens, equipped with enhanced safeguards against self-harm, violence, eating disorders, and sexual content, along with parental controls, safety alerts, and regulatory features, is a much-needed intervention.

This development recognizes that young users constitute a unique category, warranting specialized and empathetic attention. The inherent allure of AI, its highly responsive and anthropomorphic nature, and its uncanny ability to mimic empathy present formidable dangers to adolescents still honing their judgment and self-perception.

The ChatGPT for Teens rollout comes amid lawsuits in the US alleging that the chatbot contributed to teenage suicides, and a US Federal Trade Commission investigation into AI companies, including OpenAI, concerning their impact on children. Meta is currently facing a trial over allegations of deliberately exploiting young users' vulnerabilities and designing addictive platforms.

Worldwide, there is a growing backlash against the haphazard deployment of AI services to children. China has limited AI systems that foster emotional dependence, while India relies on a mix of laws, regulations, and platform-led measures. There is no reversing the tide of AI; the challenge lies in ensuring its use doesn’t compromise young people's well-being.

The safeguards announced by OpenAI, although not infallible, are a step in the right direction. Age estimation remains an approximation, children can misrepresent their age, and content restrictions depend on their enforcement. To truly safeguard young users, independent testing, greater transparency, and independent scrutiny are imperative, coupled with improved digital literacy and sensitization.

The fact that these protections emerged only after persistent advocacy underscores the need for Big Tech to shoulder responsibility for children's online safety. ChatGPT for Teens marks a beginning, but a long road of work remains.