OpenAI safety employee quits, says 'time for trial and error is over'
Writing in “I Quit OpenAI Because Its Culture Is Broken,” published by the Atlantic on Saturday, David Robinson said AI companies, including OpenAI, were not being “nearly careful enough”
A former OpenAI safety employee has resigned, criticizing the company's approach to AI safety. In an article published by The Atlantic, David Robinson argued that OpenAI is not being "nearly careful enough" in its rapid development of AI systems and should prioritize safety expertise and research before advancing more capable models.
Robinson urged the AI industry to adopt safety measures akin to those used in nuclear power and aviation, stating that the "time for trial and error" is over. OpenAI relies on an approach called "iterative deployment," where systems are released and safeguards are strengthened when problems arise. Robinson's departure comes amid growing debate within the AI sector about whether companies are moving too quickly to develop increasingly powerful systems.
OpenAI and its rival Anthropic have faced scrutiny over instances where safety controls failed or experimental systems behaved unexpectedly. Robinson, who worked at OpenAI for 3.5 years, helped draft the company's preparedness framework and oversaw safety reports for 12 frontier-model launches. He lamented that as the company races from one launch to the next, it fails to achieve the necessary level of care.
OpenAI responded by stating that they ensure their models do not become more capable than they can safely manage and will pause training or hold back models when necessary. Robinson also highlighted that AI capabilities are advancing faster than researchers' understanding of alignment, a field focused on ensuring AI systems align with human goals and values.
Written by urgent.news from The Hindu - Sci-Tech's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
This story
This is one outlet's version. Read the fullest account.
- OpenAI safety employee quits, says 'time for trial and error is over' brecorder.com
- OpenAI safety employee quits, calls for nuclear-level AI safeguards: ‘Trial and error is over’ gulfnews.com
- OpenAI Employee Quits Over 'Broken Culture', Calls For Aviation-Like Safety ndtv.com
- OpenAI safety employee quits, says ‘time for trial and error is over’ indianexpress.com