Urgent.News

What's breaking now, across thousands of outlets.

AI

OpenAI wants to stop deepfakes from overwhelming child abuse tiplines

OpenAI is announcing a tool that it says will help child sexual abuse investigators cut through the noise to find harmful material they can act on quickly. At a Monday press briefing in Washington, DC, OpenAI announced a classifier it says can better detect abusive imagery of kids, including whether it's AI-generated. It's also offering […]

OpenAI wants to stop deepfakes from overwhelming child abuse tiplines

OpenAI unveiled a new tool aimed at assisting child sexual abuse investigators in identifying and addressing abusive imagery of children. At a press briefing in Washington, DC, the company announced a classifier that can more accurately detect such content, whether it's AI-generated or not, while reducing false positives for human review.

This comes as the influx of AI-generated CSAM reports to the National Center for Missing and Exploited Children's CyberTipline has surged exponentially, overwhelming the organization's capacity to manage the workload. OpenAI's classifier is the first broadly available CSAM classifier with a specific flag for AI-generated material, offering free access to vetted organizations and providing guidance for developers and law enforcement on detecting this type of content.

The tool is designed to help triage images and distinguish between abusive AI-generated content and genuine child sexual abuse material. OpenAI's head of child safety public policy, John Buckley, emphasized the importance of recognizing the harmful potential of AI-generated CSAM, as it can erode social norms and often coexists with real child sexual abuse imagery.

OpenAI also reported that its own image generator is configured to prevent users from producing CSAM, with a 24-hour pause for first-time offenders and support resources to encourage them to seek help.

Written by urgent.news from The Verge's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at theverge.com →

More in AI

Apple is testing daily usage limits for more complex Siri AI interactions

Apple released betas of iOS 27.3, iPadOS 27.3, and macOS 27.3 today, and the company is using the update to test new per device daily usage limits for some Siri AI and Apple Intelligence features, according to MacRumors. Basic Siri commands and requests will remain free and unlimited, but more advanced features that rely on […]

More from Monday 16 November →