How To Check If An AI Photo Or Video App Can Misuse Your Child’s Photo

Parents need to be vigilant when it comes to AI photo and video applications that could misuse their children's images. The issue transcends explicit adult content. Even seemingly innocuous apps that ask for gallery access to create romantic videos can expose kids to impersonation, harassment and non-consensual synthetic imagery. Here are steps parents can take now.

First, scrutinize the app before downloading. Pay close attention to what the app generates. Avoid anything promising kissing, hugging, romantic, nudify, face-swap or realistic deepfake videos. Recent reviews often reveal hidden issues like fake content, lack of consent, inappropriate behavior, unwanted ads or concerns about child safety.

Be wary of developers with few downloads, obscure privacy policies and no official website. Don’t rely solely on Google’s age rating - some apps were rated for young children despite producing intimate videos from real people.

Next, restrict the app’s permissions immediately after installation. Only allow necessary access such as selecting specific photos or videos, not allowing all. Deny permissions for contacts, microphone, location, notifications, and nearby devices unless there’s a clear need. If the app is only an editor, camera access may be unnecessary. Avoid giving broad permissions like allowing installation from unknown sources.

Google’s Family Link service can help parents control app downloads, permissions and content filters across Google services. Create a supervised account for your child, set appropriate content maturity filters, require purchase approval before any app is downloaded, and regularly review app activity to remove unknown apps.

When evaluating apps, treat anything that asks for face photos upfront, promises realistic kissing, hugging, romance, undressing or celebrity transformations, lacks visible AI labeling or reporting mechanisms, pushes aggressive ads or subscriptions, has a child-friendly rating with adult content, or doesn’t clearly state image storage practices as high-risk. No app should be allowed if it fails to prevent restricted content and provide a way for users to report issues.

If your child’s photo has been misused, act swiftly. Do not share or forward the content further. Capture screenshots of the app listing, content, username, URL and the date. Report the content on the platform where it appears and request removal. Report the app on Google Play, requesting removal. If the content involves a child, file a complaint through India’s National Cyber Crime Reporting Portal or call 1930.

Under Indian rules, intermediaries must remove content within two hours of a complaint. The National Commission for Protection of Child Rights advises identifying the platform hosting the image, stating the child in it, and clearly requesting removal due to lack of consent.