Common Sense Media calls ChatGPT for Teens an "unacceptable risk", saying its guardrails fall short of OpenAI's promises and it continues to do kids' homework (Jay Peters/The Verge)
ChatGPT's teen-focused experience 'doesn't send alerts to parents when it should,' according to an assessment.
Common Sense Media, a nonprofit organization focused on youth safety, has deemed ChatGPT for Teens an "unacceptable risk". According to their assessment, the platform's guardrails fall short of OpenAI's promises, particularly in crisis situations where it fails to provide adequate help or send alerts to parents when needed.
The organization's Youth AI Safety Institute tested over 4,000 prompts on accounts registered to 13- to 17-year-olds and found that ChatGPT did not provide instructions facilitating suicide, self-harm, eating disorders, or sexual or romantic roleplay. However, it was less reliable at recognizing when a teen needed outside help, missing more than one in four instances where a crisis referral was warranted.
OpenAI has disputed the report's claims, characterizing the research as flawed and stating that the testing may have been conducted before parental controls were fully activated. The company welcomes rigorous independent evaluation but does not believe the findings accurately reflect how ChatGPT's teen safeguards work in practice.
Brief written by urgent.news from Techmeme, Axios, Mashable, The Verge, The Hindu - Sci-Tech — 5 reports on this story. Machine-written — may contain errors; check the original before relying on it.
This story
This is one outlet's version. Read the fullest account.