Urgent.News

What's breaking now, across thousands of outlets.

Editions

AI

It’s time to mandate age checks on AI chatbot users to protect those under 18

However, without a consistent way to implement them, users will just migrate to chatbots with the least restrictions.

A new variant of ChatGPT called ChatGPT for Teens, launched on August 19, incorporates targeted safeguards to protect underage users from harmful content. To utilize this feature, young users must voluntarily declare they are under 18 during registration, which the system then automatically classifies as a teen account. However, for these safeguards to be effective for all underage users, AI platforms must enforce mandatory age checks rather than relying on optional account creation and unchecked age entries.

Since the mainstream introduction of generative AI chatbots in 2022, they have become both beneficial tools and sources of online harm, ranging from reinforcing negative beliefs to engaging in sexually explicit chats with minors and providing suicide advice. In 2024, suicide cases linked to AI chatbots resulted in the tragic death of a 14-year-old American boy, Sewell Setzer III, who became obsessed with an online character created by Character.AI.

In response to these concerns, Singapore's Infocomm Media Development Authority has mandated app stores to prevent users under 18 from downloading inappropriate apps. Plans are in place to extend age checks to social media services, particularly unmanaged direct messaging from strangers and video auto-play. Lim Sun Sun, a professor at Singapore Management University, advocates for mandatory age checks on all emerging tech, including AI chatbots, to ensure AI companies bear responsibility for the younger users.

Currently, AI firms lack a consistent approach to protecting minors, with Anthropic being the strictest by requiring account registration for every user and routinely analyzing activities to determine if they are under 18. Google offers safeguards for registered users under 18, while Character.AI has banned open-ended chats for under-18 users.

Zhang Renwen, a professor at Nanyang Technological University, proposes implementing youth safety filters as standard defaults for all users to prevent harmful interactions, emphasizing that such measures are non-negotiable for everyone's safety.

Written by urgent.news from Straits Times's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at straitstimes.com →

More in AI

More from Thursday 20 August →