OpenAI adds stricter limits for teens asking about firearms
The company said these tighter restrictions apply even if the question asked "appears harmless."
OpenAI has introduced stricter rules concerning teens inquiring about firearms via ChatGPT, even if the query seems harmless. The company extended its existing policies that thwart ChatGPT from aiding users in carrying out violent acts or obtaining weapons. OpenAI aims to further restrict practical information about weapons and security systems that could potentially be misused for violent purposes, even without apparent violent intent from the teen user.
Despite these new limitations, teens will still be able to utilize ChatGPT for purposes such as preventing or de-escalating violence, seeking assistance, and connecting with a responsible adult. OpenAI is also reinforcing policy boundaries for all its users, particularly when questioned about reconstructions of past mass attacks, including specifics about the weapons employed and their acquisition, as well as detailed comparisons on the scale of harm that could enhance an attacker's notoriety.
These new restrictions work in tandem with the parental controls introduced last year, which notify parents if their linked teen accounts breach ChatGPT policies related to violent threats or acts of violence. This additional safety measure follows a wrongful death lawsuit last year and OpenAI's CEO, Sam Altman's public apology for failing to alert police to alarming chat logs in connection with the Tumbler Ridge shooting earlier this year.
OpenAI plans to release its first Community Safety Report in early 2027, with updates every six months.
Written by urgent.news from Engadget's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
