As Xi Jinping visits Washington, Chinese economists warn that Beijing's heavy focus on AI comes at the expense of addressing a severe broader economic crisis (Li Yuan/New York Times)

While American AI researchers grapple with concerns about the potential for superintelligence to destroy humanity, Chinese policymakers have historically prioritized immediate risks like deepfakes and child safety. However, the sophisticated hacking capabilities of advanced artificial intelligence systems are prompting Beijing to reassess the dangers, with the chief of the spy agency warning that AI could jeopardize national security.

A small team of programmers in California recently demonstrated this by using AI to create a cyberattack worm that, if deployed, could easily compromise millions of WeChat accounts. Kevin Xu, founder of US-based technology hedge fund Interconnected Capital, notes that China and the United States share many AI safety concerns, but unlike in America, these issues are not widely discussed or debated publicly in China.

The cybersecurity impact of AI agents operating without human oversight is considered a top priority by the Chinese government. As the topic gains global attention, President Xi Jinping and US President Donald Trump are under pressure to address AI threats during upcoming in-person talks, despite their rivalry in the field. While both countries are developing a more realistic understanding of the risks, joint efforts to evaluate AI models for safety or establish alert systems could be hampered by intense competition.

US President Trump has expressed reluctance to slow down cutting-edge AI development, stating that China should not be allowed to surpass the US in this area. Meanwhile, China has already implemented some regulations, such as prohibiting the creation of AI-generated avatars in someone's likeness without consent. Brian Tse, CEO of Beijing-based consultancy Concordia AI, emphasizes that China's AI policy focuses on addressing real-world harms to society and people, viewing AI as a general-purpose technology similar to electricity or automobiles that can be managed through regulation.

Recent advancements in AI and high-profile incidents are pushing the technology higher on the list of priorities for China. On the streets of Shanghai, opinions on AI are mixed, with some viewing recent warnings as beneficial for improving cybersecurity and others advocating for stringent regulation.