AI Photo Craze Comes With A Dark Side! Deepfakes, Blackmail & Identity Theft Risks Rise In Bhopal

Bhopal, Madhya Pradesh: The rising popularity of AI-generated photographs presents a dark side, with the potential for misuse leading to security risks such as deepfakes, blackmail and identity theft. As cyber experts warn, the biggest threat is not just cybercriminals stealing photos from social media, but also people close to the victim using accessible AI tools to manipulate images and videos.

In June, a young woman in Bhopal reportedly turned down a marriage proposal, after which a male acquaintance allegedly misused her photo and AI to create an obscene image, which was then widely shared. A year ago in Nishatpura, a woman used AI to fabricate fake obscene photos of her boyfriend's mother and sister when he refused marriage.

In Anuppur district, two girls fell victim to AI-generated obscene videos created by their roommate from their own photographs. In Bhopal itself, a case of an AI-generated obscene video of a minor emerged four months ago.

Such incidents highlight concerns over the misuse of facial photographs and the easy availability of AI-based image and video manipulation tools. Cyber police officials urge users to refrain from uploading clear, high-resolution photos to unidentified AI apps or websites, as many platforms ask for facial photos without disclosing storage duration, access permissions or potential misuse. These apps can later be exploited for deepfakes, fake profiles, fraudulent video calls or blackmail.

Another risk lies in automatic payments. Some AI apps offer free features initially but push users towards subscriptions, which can result in unwanted recurring charges if payment details are entered without reviewing terms. MP GRP's QIRT Boost in Rail Crime Recovery has detected and recovered nearly ₹4 crore in Bhopal and Jabalpur.