‘Being heard and accepted, even by a machine, can be meaningful’ — I asked a therapist if other countries should restrict AI companions like China

Regulations in China have recently been introduced to limit the use of AI companions, with the aim of preventing emotional addiction and the damage to real interpersonal relationships that can arise from these interactions. This new rule has already started affecting the thriving AI companion industry in China, with major tech companies like ByteDance, Tencent and Alibaba having to comply with the safety evaluations and suspensions for unsafe services.

Some companies have even disabled personality features in an attempt to avoid these restrictions, leaving users disheartened and heartbroken.

Amy Sutton, a therapist from Freedom Counselling, shared her insights on this matter, emphasizing that AI companions may be a symptom of a broader trend of individualism that has eroded community contexts. She highlighted the decline of social spaces where people traditionally learned how to form relationships, like pubs, parks, community centers and youth clubs.

In addition, the pandemic, social media, remote working, and lack of investment in mental health services have contributed to increased loneliness, making people more reliant on technology for connection.

Sutton argued that regulation should be implemented, but it must address the root causes that have fuelled the demand for AI companions. While there are concerns about the potential negative effects of excessive time spent on AI relationships, Sutton also pointed out that AI could be beneficial in building social skills for those who have been let down by human relationships or have been unable to access appropriate human services.

However, she stressed that most AI tools currently do not help users transition away from them, instead designed to keep users engaged and coming back for more.