AI 'warning shots' focus Beijing on national security risks

China's policymakers have traditionally focused on more immediate AI risks, such as deepfakes and child safety. However, the alarming hacking capabilities of advanced AI models have shifted Beijing's attention to national security concerns. The spy agency chief recently warned that AI technology could jeopardize national security.

This shift in focus comes as a small team of California programmers demonstrated how AI could be used to create a cyberattack worm capable of compromising millions of WeChat accounts. Kevin Xu, founder of US-based technology hedge fund Interconnected Capital, noted that AI safety issues in China and the United States share similarities, though Chinese concerns seldom become public.

The cybersecurity impact of AI agent bots operating without human oversight is considered very high by the Chinese government. President Xi Jinping and US President Donald Trump are under pressure to discuss AI threats at upcoming talks, despite their competitive rivalry. Both nations are working towards a more realistic and shared understanding of these risks, but fierce competition may hinder cooperation on safety evaluations.

China's approach to AI regulation focuses on present-day societal and individual harms, viewing AI as a general-purpose technology similar to electricity or automobiles. While recent AI developments have raised concerns, many believe that addressing the identified issues will ultimately benefit cybersecurity and technological advancement.