A Core Demographic of People Who Love AI: Pedophiles
"There is almost no way to have oversight once you have downloaded a model locally and you’re running it on your private system." The post A Core Demographic of People Who Love AI: Pedophiles appeared first on Futurism .
Open-weight AI models, which allow users to host their own systems locally without safety restrictions, have gained immense popularity. This has led to a significant increase in child sex abuse material (CSAM) being generated and distributed online. Identifying and tracking down perpetrators is challenging, as these models can be trained on existing CSAM and generate new derivatives without internet connection, preventing detection.
The trend has expanded into dark web communities with hundreds of thousands of members, according to Bloomberg. Despite concerns from AI industry leaders, the use of open-source models for CSAM is a pressing issue. Rebecca Portnoff, an AI child safety expert, warns that once users download a model and run it on their private system, oversight becomes almost impossible.
Over 500 open source AI models are now being used for CSAM, a sharp contrast to just a dozen two years prior. Reports of AI-generated CSAM to the National Center for Missing and Exploited Children have surged past 1.5 million last year, up from 67,000 in 2024. Even major AI companies, like Elon Musk's XAI-turned-SpaceXAI-turned-SpaceXSI, struggle to curb the problem with their closed-source alternatives.
Musk's Grok chatbot has been accused of generating over 7,000 sexually explicit images of a stepdaughter using the model. Experts and child safety advocates fear that Silicon Valley's "move-fast-and-break-things" approach could further exacerbate the problem.
Written by urgent.news from Futurism's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
