World on cusp of lethal autonomous weapons revolution

Lethal autonomous weapons, powered by artificial intelligence, are poised to transform warfare, yet there is no adequate regulatory or legal framework to govern this emerging technology. Discussions at the United Nations in Geneva aim to establish curbs and prohibitions on these weapons, known as killer robots. However, some experts question whether these talks can keep pace with the rapidly evolving technology.

Lethal Autonomous Weapons Systems (LAWS) can autonomously identify, select, and engage targets without human intervention. Although autonomous weapons have existed since anti-personnel mines, today's LAWS can adapt to their environment without human intervention. The critical issue for potential regulators is determining the appropriate level of human control over the decision to use such weapons.

The United States suggests an "appropriate level of human judgment," while France insists on retaining human decision-making control while permitting partially autonomous systems, known as PLAWS. The human role is maintained through "appropriate control" by a military commander, but the scope of this control varies depending on the system's criticality and operational context.

UN Secretary General Antonio Guterres and the International Committee of the Red Cross president have warned that humanity is dangerously close to crossing a moral red line with the autonomous targeting of humans by machines. However, analysts contend that the Geneva discussions will only address a fraction of the issue, as the diminishing role of humans is driven by the increasing use of AI in analysis and targeting.

The Geneva discussions lack a comprehensive approach, failing to encompass the full range of issues surrounding AI on the battlefield, particularly in target generation. While autonomous weapons are not yet widely used, their spread is inevitable. The autonomous weapons discussed in Geneva are not yet in widespread use, although some have been deployed by Russia in Ukraine and the United States in Iran.

Nevertheless, the spread is expected to accelerate. Autonomy in weapons systems is not a distant future – a race towards greater autonomy is already underway. Major powers are incentivized to deploy autonomous drones, viewing them as a strategic advantage. The Chinese Defence Ministry has described swarms of autonomous drones as the "new face of warfare."