AI doomsday debate: What are AI researchers and critics afraid of?
Critics fall into two camps. One warns that future, more capable AI systems could go ‘rogue’ and act against human interests. The other flags harm already caused by AI systems deployed today, regardless of whether AI ever ‘escapes’ human control at all
OpenAI's CEO, Sam Altman, declared in mid-September that the company's long-awaited IPO would not proceed in 2026. His primary concern was AI safety, citing a 10% risk of AI causing "human extinction" by the end of the decade. This stance followed an ex-Anthropic researcher's resignation due to fears of AI companies racing ahead without adequate control measures.
Researchers and critics alike have debated the potential dangers and benefits of AI, with some warning of AI "going rogue" and acting against human interests, while others highlight the existing harms caused by current AI systems. The debate revolves around three main questions: the future capabilities of AI systems, the likelihood of catastrophic loss of control, and whether focusing on this risk detracts from addressing existing issues.
Despite the controversy, AI companies have largely dismissed calls for a temporary pause in development, emphasizing existing safety measures instead.
Written by urgent.news from The Hindu - Sci-Tech's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
