Apple and Google Face Scrutiny Over 400 Apps and Websites Linked to AI Deepfakes

An investigation by WIRED has revealed that over 400 apps and websites across platforms like Meta’s advertising services, Apple's App Store, and Google Play are linked to the distribution of AI-generated sexual deepfakes. This operation reportedly involved developers hiding abusive functionality within seemingly innocuous AI products, which could be activated on users' devices after installation.

While Apple, Google, and Meta have taken enforcement actions against identified applications, the use of remote servers to control hidden features suggests that removing these listings and advertising accounts may not be sufficient to dismantle the entire infrastructure. The investigation also found that hundreds of apps shared code and infrastructure, with connections tracing back to Chinese developers and KeLing Technology Limited, a Hong Kong-based company.

Despite Apple and Google's efforts to remove violating applications, the investigation raises questions about the effectiveness of app-store reviews in preventing the distribution of harmful content. Users are advised to remain vigilant for suspicious applications, especially those promoted via social media, and report any apps that conceal their true functionality or promote nonconsensual image generation to the respective app stores.

Additionally, the case highlights the need for platform operators to develop more robust protections against deceptive behavior that may only manifest after an application has been approved for distribution.