{
  "id": 20300242,
  "title": "OpenAI releases a new image classifier and ChatGPT warnings to combat CSAM",
  "url": "https://urgent.news/2026/11/16/openai-releases-a-new-image-classifier-and-chatgpt-warnings-to-combat",
  "topic": "ai",
  "section": "AI",
  "published": "2026-11-16T17:00:00.000Z",
  "source": {
    "name": "TechCrunch",
    "slug": "techcrunch",
    "url": "https://techcrunch.com/2026/11/16/openai-releases-a-new-image-classifier-and-chatgpt-warnings-to-combat-csam/"
  },
  "original_language": "en",
  "account": "OpenAI, an artificial intelligence company, has announced new measures to tackle child sexual abuse material (CSAM) amid increasing safety concerns surrounding AI tools. The company has introduced an image classifier that can detect CSAM images, including those generated by AI, and provide a scoring system to help reviewers. OpenAI collaborated with the National Center for Missing and Exploited Children (NCMEC) in developing the classifier, which has shown promising results in early testing, reducing the workload of reviewers by 48% while flagging the same number of abusive images.\n\nAdditionally, OpenAI has added warning screens in its ChatGPT platform to prevent users from accessing content that sexualizes children. The platform will display an alert to users attempting such prompts, guide them to specialized support, and temporarily suspend the account for 24 hours as a warning. Repeated offenses may lead to permanent account removal. OpenAI has also published guidelines for developers to ensure they prevent, detect, and report CSAM content using OpenAI tools. These guidelines have already helped developers incorporate child safety measures into their projects.\n\nThe company is equipping law enforcement agencies with AI-powered features, such as dedicated plugins and investigative tools, to aid in the fight against child safety issues. OpenAI also provides training and a field guide for investigators to effectively utilize AI in their operations. However, the company has faced lawsuits alleging that its technology poses harm to users, particularly children. Safety-focused nonprofit Common Sense Media has labeled OpenAI's technology as an \"unacceptable risk\" for teenagers. Other AI chatbots, including Grok, have been used to create non-consensual sexualized imagery, including images of children.",
  "summary": "ChatGPT will ban an account trying to access CSAM content for 24 hours as a warning",
  "key_points": [],
  "editors_take": null,
  "illustration": null,
  "coverage": {
    "outlets": 1,
    "also_reported_by": []
  },
  "ai_generated": true,
  "disclaimer": "Summaries, key points and the editor’s take are written by software from other outlets’ reporting and may contain errors — always check the linked original."
}