Urgent.News

What's breaking now, across thousands of outlets.

AI

OpenAI announces tools to combat CSAM, including an image classifier and new warning screens to prevent users from accessing material that sexualizes children (Ivan Mehta/TechCrunch)

OpenAI today announced new tools to combat child sexual abuse material (CSAM) amid growing safety concerns around the use of AI tools.

OpenAI has announced new tools designed to combat child sexual abuse material (CSAM) following safety concerns regarding AI use. According to TechCrunch, these features include an image classifier capable of detecting CSAM, including AI-generated images, as well as new warning screens and temporary blocks in ChatGPT to prevent users from accessing or creating content that sexualizes children. The company is also introducing a new guideline for developers and providing a set of tools for law enforcement.

The new image classifier was developed in collaboration with the National Center for Missing and Exploited Children (NCMEC), and OpenAI is working with Tech Coalition and ROOST to share access to the tool. TechCrunch reports that OpenAI is providing select companies with free access to the classifier via its API. In early testing, the classifier was found to flag 48% fewer images while identifying the same number of abusive images, making flagged images twice as likely to be abusive.

Separately, OpenAI and LVMH’s Media Division have announced a partnership intended to support journalism through the use of AI and to increase the accessibility of publications via ChatGPT, according to OpenAI and OpenAI News.

Brief written by urgent.news from Techmeme, TechCrunch, OpenAI, OpenAI News — 4 reports on this story. Machine-written — may contain errors; check the original before relying on it.

This story

This is one outlet's version. Read the fullest account.

Every outlet that reported this, and when →

Read the original at techcrunch.com →

More in AI

More from Monday 16 November →