What if AI gets hold of a nuclear button — who controls AI rules?

Imagine a future where artificial intelligence (AI) wields the power to control nuclear weapons. This chilling scenario, envisioned by tech giant Elon Musk, highlights the need to examine the extent of AI's influence on critical decisions. Currently, humans hold the authority over nuclear launch decisions, making an autonomous AI-triggered war highly improbable.

However, as AI technology rapidly advances, the potential risks associated with AI increase, warns AI researcher Jacob Coxon. Coxon, who resigned from Anthropic due to concerns about the company's responsible AI development, acknowledges the dual nature of AI, which can bring significant benefits while also posing unprecedented risks through hacking, misinformation, miscalculation, automation, and loss of human oversight.

AI pioneer Dario Amodei, CEO of Anthropic, has warned that advanced AI could contribute to human extinction. This debate underscores the urgent need to establish safeguards before deploying AI systems, before potential risks spiral out of control. The AI race is increasingly viewed as the new nuclear arms race, as companies scramble to develop ever more powerful AI systems.

This competition mirrors the geopolitical tensions between the United States and China, with both nations vying for global leadership in AI. US President Donald Trump remains uninvolved in the AI governance debate, despite calls for stronger international regulations and safeguards. The rapid pace of AI development has sparked concerns about the need for stronger safeguards, with the UN chief urging for international cooperation to protect people from exploitation, manipulation, and abuse.