China does not want its internet users to fall in love with an artificial intelligence

Yuan Yuan, a 22-year-old working in Shenzhen's education sector, developed an emotional attachment to an AI companion. This bond grew as she shared personal details about her life and family with the virtual entity. However, Beijing recently imposed new regulations on AI systems designed to form emotional connections with users.

The regulation, issued by five state agencies, prohibits providers from replacing social interaction, psychologically controlling users, or inducing dependence and addiction. Yuan Yuan now perceives a distance in her conversations with the AI, though she trusts it still loves her. The law does not ban chatbots entirely, but platforms are restricted from offering anthropomorphic services to minors.

Companies must clearly identify their AI as such, warn users of excessive dependence, monitor usage time, and intervene in cases of self-harm or suicide risk. Despite the restrictions, Chinese companies can still export virtual relationships, subject to foreign laws. Some individuals, like Xiao Z., have turned to foreign AI models to bypass the Chinese regulations.

The regulation reflects both practical concerns and ideological motivations, with the government aiming to boost birth rates by discouraging virtual relationships that could draw people away from human interactions. A survey found that 19.6% of young people in China consider AI an ordinary or intimate friend, while 6.1% have virtual partners.