[Interview] AI risk expert Nick Bostrom says pausing development will come at ‘cost’

Artificial intelligence pioneer Nick Bostrom warned during a recent interview that the development of powerful AI systems could lead to an "existential catastrophe." While acknowledging both alarming and promising developments in AI, Bostrom maintained that his assessment of the risks has remained steady over the past two years.

He cautioned that a slightly misaligned AI could rapidly give rise to systems that pose a severe existential threat. Bostrom, who authored the influential book "Superintelligence," emphasized the need for swift action and a gradual approach to AI development, likening the pursuit of superintelligence to undergoing "risky surgery for a condition that will otherwise prove fatal."

He argued that it would be most beneficial to pause AI development only when systems are nearing superintelligence levels, allowing time to evaluate and implement necessary safety measures.