Apple adds further App Store restrictions around AI nudify apps

Apple is tightening its control over the iOS App Store, particularly concerning AI deepfake nude photos. The company announced changes to its moderation policies for the App Store, aimed at apps that generate nonconsensual intimate imagery of real people using user-generated content tools. While pornography is already prohibited on the App Store, apps that have the potential to create such content are now required to implement stricter content filtering, reporting mechanisms, upload prevention, and removal of any content that passes these checks.

Developers must self-police more thoroughly to ensure compliance with these rules. If an app violates these guidelines, including a new prohibition on bait and switch tactics (misrepresenting app functionality during the submission review period), it can be removed from the App Store. Developers found in violation can also have their ability to submit apps to the App Store revoked.

Recent research uncovered numerous apps capable of creating deepfake nudes of real people on both Apple's and Google's platforms. While Apple had previously removed many of these offending apps, the new rules indicate ongoing efforts to prevent their resurgence in the App Store.