Tech leaders warn UN of AI’s risk to humanity

Leading technology figures have urged the United Nations to establish comprehensive global guidelines to regulate the rapid advancement of artificial intelligence. Dario Amodei, CEO of Anthropic, warned that mismanagement of AI could pose a risk to humanity as a whole during his address to the UN Security Council. OpenAI CEO Sam Altman proposed a framework for international and national standards governing AI capabilities, risk assessment, compliance verification, and maintaining human oversight as systems become increasingly autonomous.

Altman emphasized the necessity of standardized measurement, transparent reporting of incidents, and secure communication channels among governments, critical infrastructure operators, and technical experts. He stressed that standards should not prioritize one business model over another and should accommodate both open and closed model developers, as well as new entrants and established labs, along with national authorities and international collaboration.

British Foreign Secretary Ed Miliband emphasized the urgency of the AI leaders' message, urging governments not to neglect their responsibilities to citizens and private companies. Miliband highlighted that while AI holds immense potential for economic growth, medical advancements, and improving people's lives, it is crucial to implement safeguards to ensure its secure, safe, and trustworthy implementation.