OpenAI safety employee quits, calls for nuclear-level AI safeguards: ‘Trial and error is over’
A former OpenAI safety employee has criticised the company’s approach to artificial intelligence development, arguing that the industry is moving too quickly as increasingly powerful AI systems bring greater risks. David Robinson, who spent three and a half years at OpenAI, resigned recently and outlined his concerns in an essay published by The Atlantic on Saturday. Robinson helped draft…
David Robinson, a former OpenAI safety employee, has resigned and expressed concerns about the company's approach to artificial intelligence development. In a recent essay published by The Atlantic, Robinson criticized the rapid pace at which AI systems are being developed, arguing that the industry is moving too quickly and increasing the risks associated with these systems.
Robinson was involved in drafting OpenAI's preparedness framework and oversaw safety reports for 12 launches of frontier AI models. He emphasized that companies like OpenAI must prioritize safety expertise and research before developing more capable systems, stating, "The time for trial and error is over." Robinson highlighted the need for stronger AI safeguards, comparing advanced AI systems to those in high-risk industries such as nuclear power and aviation, which employ multiple layers of oversight and planning to mitigate the impact of human error.
He also noted that AI capabilities are advancing faster than researchers' understanding of "alignment," the field focused on ensuring AI systems behave in accordance with human goals and values. OpenAI, however, disputed Robinson's criticism of its safety practices, stating that they are ensuring their models do not become more capable than they can safely manage and securing them when necessary.
The company highlighted its efforts to strengthen security in research and testing environments, train models to operate responsibly, expand work with third-party evaluators, and improve real-time monitoring to identify concerning behavior earlier. The debate surrounding AI safety has intensified as OpenAI and other AI companies face increasing scrutiny over the testing and control of increasingly autonomous systems.
Written by urgent.news from Gulf News's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
Also reported by 4 other outlets
- OpenAI safety employee quits, says 'time for trial and error is over' brecorder.com
- OpenAI Employee Quits Over 'Broken Culture', Calls For Aviation-Like Safety ndtv.com
- OpenAI safety employee quits, says 'time for trial and error is over' thehindu.com
- OpenAI safety employee quits, says ‘time for trial and error is over’ indianexpress.com