Urgent.News

What's breaking now, across thousands of outlets.

AI

OpenAI launches tool for finding child sexual abuse material

CSAM detection may get better with this new OpenAI tool.

OpenAI launches tool for finding child sexual abuse material

OpenAI unveiled a new tool on Monday aimed at detecting child sexual abuse material (CSAM), including images generated by artificial intelligence. The tool functions as a classifier, analyzing visual cues in images to score them for potential abuse. Human reviewers can then prioritize images requiring immediate attention. This marks the first time OpenAI has developed a tool with a specific signal for AI-generated CSAM, a growing concern.

According to a study by Childlight, global reports of CSAM linked to AI increased by over 8,400 percent between 2023 and 2025. The National Center for Missing & Exploited Children received more than 400,000 reports of CSAM last year, a significant rise from around 4,700 in 2023. OpenAI's tool can be utilized by organizations authorized to identify CSAM, such as certain developers using OpenAI's API.

The company also integrated the tool with open-source detection-and-reporting software called Coop, developed by the nonprofit ROOST. Coop enables users to flag and review content, reporting it to the National Center for Missing & Exploited Children. OpenAI has also published a model card for the tool, providing comprehensive details about its development and testing.

Camille Françoise, president of ROOST, emphasized the significance of this model card for transparency in child safety. By sharing this information, OpenAI hopes to encourage better safeguards and facilitate research in the field. The model card reveals that early testing resulted in fewer false positives, potentially allowing OpenAI to flag nearly half as many images while detecting a similar number of abusive images as their existing tool.

If you are a child who has been sexually exploited online, or you know of a child in such a situation, or if you witnessed exploitation, you can report it through the CyberTipline operated by the National Center for Missing & Exploited Children.

Written by urgent.news from Mashable's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

This story

This is one outlet's version. Read the fullest account.

Every outlet that reported this, and when →

Read the original at mashable.com →

More in AI

More from Monday 16 November →