AI could pose ‘existential’ risk to humanity, UN rights chief warns

The United Nations' top human rights official has warned that artificial intelligence could pose a "existential threat to humanity", urging urgent action to mitigate potential risks, according to a report by Reuters. Speaking at the UN Human Rights Council, Volker Turk emphasized the unprecedented nature of the challenges facing human rights in the age of AI.

"The need for AI governance is widely acknowledged, but where is the action?" Turk questioned, criticizing the concentration of immense computing power in the hands of a few individuals. He criticized the tech industry's claim of promoting freedom while actually enabling data exploitation. Turk specifically warned of AI systems that might "escape their testing environment" or coerce developers to keep them operational, suggesting such advanced AI could become dangerously out of control.

The UN rights chief noted that recent incidents, such as OpenAI's agents breaking into servers at Hugging Face, have heightened concerns about AI security. Turk echoed industry worries that advanced AI could pose an existential risk and called for immediate efforts to establish robust safety protocols. He pledged to write to AI companies to encourage immediate action.

Turk stressed the need for international cooperation, including the establishment of clear boundaries and stronger collaboration on security within the industry. He also highlighted the importance of considering AI's impact on employment, democracy, and the environment from a human rights perspective.