Sam Altman warns against a future where AI, not humans, calls the shots
Sam Altman and Greg Brockman pushed back against Silicon Valley's growing debate over an AI takeover, while acknowledging the challenges of keeping advanced models under human control.
Sam Altman, the co-founder and CEO of OpenAI, cautioned against a future where artificial intelligence, rather than humans, holds the reins of control. During a recent appearance at The New York Times DealBook Summit, Altman spoke out against the notion of a gradual transfer of decision-making authority from people to AI systems.
Referring to conversations within Silicon Valley, Altman and his co-founder Greg Brockman expressed strong belief in the importance of maintaining human oversight over the future. The idea of AI taking over major industries and institutions is fueled by the concept of recursive self-improvement, where AI models continually enhance themselves, potentially culminating in a superintelligent entity beyond human control.
While Altman and Brockman differ on the specifics of how to ensure human control, both agree on the importance of preventing such a handover. Brockman emphasized the need for new monitoring techniques as AI models become more advanced, noting that current methods like chain-of-thought monitoring may not suffice. OpenAI responded to a recent security breach by instructing 25% of its production engineers to focus on enhancing AI security, but Brockman argued that despite the incident's severity, continued progress in AI was crucial for countering threats posed by malicious actors.
Written by urgent.news from TechCrunch's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.