Should we be skeptical about the AI panic?

In recent weeks, AI risk activists have gathered near Downing Street in London, England, sparking concern about the potential dangers of artificial intelligence. This is not a new question within Silicon Valley, but Jacob Coxon's recent post on X, claiming that AI could "kill us all by the end of the decade," has amplified fear and skepticism about AI's potential to wipe out humanity.

Coxon, an Anthropic employee, asserts that this is not a marketing ploy and that many executives and senior researchers privately share similar fears. However, the AI industry has responded swiftly, with Anthropic CEO Dario Amodei calling for an industry-wide slowdown on frontier AI research, and other leaders like Sam Altman and Elon Musk also echoing this sentiment.

While some in Silicon Valley acknowledge the potential risks, others remain skeptical of the AI apocalypse narrative. David Sacks, an AI adviser to the Trump administration, labels this concern as "doomerism" and argues that calls for AI regulation are merely an attempt to slow down progress and gain control over the technology they are developing. Critics claim that the push for AI regulation is driven by a desire for regulatory capture, rather than genuine concerns about safety.

However, those who support the need for AI regulation argue that the current trajectory of AI development is unsustainable and poses a significant risk to humanity. Anthropic CEO Dario Amodei has proposed a call for the entire AI industry to "pace the frontier" by adopting independent evaluators within their companies, collaborating with the US government to establish safety guidelines, and engaging in international agreements with other nations to avoid a competitive race to develop the most advanced AI systems.

While skeptics remain, it is essential to acknowledge the growing concern surrounding AI's potential risks and the calls for more responsible and regulated development.