AI firms taking ‘catastrophically high’ risks, ex-OpenAI researcher warns MPs
The world’s biggest AI companies are taking “catastrophically high” risks in their race to develop superintelligent systems, a former OpenAI researcher has warned MPs, as Parliament examines whether tech giants can be trusted to regulate themselves. Daniel Kokotajlo, who quit the ChatGPT maker over safety concerns, told the Business, Innovation, Science and Trade (BIST) Committee [...]
A former OpenAI researcher has warned members of Parliament that the world's leading AI companies are taking "catastrophically high" risks in their pursuit of superintelligent systems. Daniel Kokotajlo, who resigned from OpenAI over safety concerns, told the Business, Innovation, Science and Trade Committee that the industry's risk tolerance is too high.
Kokotajlo left OpenAI after losing confidence in the company's commitment to responsible development of this potentially unpredictable technology. He also alleged that staff faced pressure to downplay concerns about the technology. Steven Adler, another former OpenAI researcher, echoed Kokotajlo's concerns, stating that internal resistance to describing the technology as "dangerous" had been present.
Both researchers emphasized that advancements in AI capabilities are far outpacing progress in safety measures. Experts warned that AI safety fears are mounting as Parliament scrutinizes tech giants' trustworthiness in self-regulation.
Written by urgent.news from City AM's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
