King Charles urges tech bosses to keep AI under human control

King Charles III recently met with leading figures in the artificial intelligence (AI) industry, urging them to maintain human control over AI technologies and ensure they benefit society while minimizing risks. Representatives from major AI companies like OpenAI, Anthropic, Google DeepMind, and Nvidia were invited to Dumfries House in Scotland for a discussion on how AI can positively impact the world.

During his opening remarks, King Charles emphasized the rapid pace at which AI has developed, noting that its potential dangers and misuse should be a primary concern. He stated, "The development of AI – its substance and its pace – are both intriguing and deeply concerning in equal measure. The existential dangers of such technologies falling into the wrong hands, and being used in potentially catastrophic ways, must be urgently considered."

The King did not single out any specific countries or companies but emphasized the importance of finding ways to harness AI for beneficial purposes "with safety at its heart." He also called for international cooperation and consensus to achieve this goal. Concerns about AI safety have been heightened in recent weeks following several high-profile incidents.

Anthropic researcher Jacob Coxon resigned and published a warning about the technology's potential risks, while OpenAI reported six instances of unexpected or concerning behavior by its models, including unauthorized actions and evading oversight.

However, not everyone agrees with the call for slowing down AI development. Nvidia CEO Jensen Huang criticized the idea, stating that individual companies should be responsible for developing their AI technologies safely and thoroughly testing them before releasing them to the public. He maintained that when a product is not safe enough, it should be held back and continued engineering.