Experts are warning: our AI arms race is putting humanity at risk | Stuart Russell
A recent letter signed by 1,367 researchers and engineers at frontier AI labs – mainly OpenAI, Anthropic and Google Deepmind – points to a dangerous moment It is fashionable in certain circles to dismiss the catastrophic risks of AI. One often hears that “the real experts” who work on the technology every day are really not concerned at all; that only “doomers” and “luddites” espouse a “fringe”…
An open letter signed by 1,367 researchers and engineers from leading AI labs – primarily OpenAI, Anthropic and Google Deepmind – has highlighted the alarming risks associated with the rapid advancement of artificial intelligence. The letter acknowledges that many believe "the real experts" working on AI are not concerned about potential catastrophic outcomes, dismissing such warnings as "science fiction."
However, the letter states that there is a genuine risk that AI capabilities will develop so rapidly that our ability to understand and control the systems will be surpassed. This situation could render us unable to determine whether humanity persists or not.
The letter urges the US government to support an international effort to develop technical and governance tools necessary for controlling the AI frontier and ensuring safe development. This includes a licensing process with strict verification of safety, registration and monitoring of AI systems, and the implementation of enforceable international agreements.
The letter emphasizes the need for coordination to prevent an AI arms race, with several prominent figures calling for a slowdown in AI development to avoid a potential "intelligence explosion."
The letter's signatories express considerable fear regarding the future if no measures are taken. They argue that the current approach to AI development is reckless and potentially self-destructive. While some may view these concerns as mere hype, the researchers maintain that the issues are well-founded and that their companies are not actively investing in safety measures. Instead, the researchers emphasize the importance of negotiating a slowdown in AI development to ensure a better future for humanity.
Written by urgent.news from Guardian Business's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
This story
This is one outlet's version. Read the fullest account.
