Confluent cofounder says believing in AI's upside means reckoning with its 'dark side'
Confluent's cofounder, Jay Kreps, says AI's rapid progress makes its risks impossible to dismiss as a marketing ploy.
Jay Kreps, a co-founder of Confluent, stated that AI's dark side must be acknowledged alongside its positive potential. He believes recent fears about AI are not simply marketing tactics. Kreps, who previously served on Anthropic's board, emphasizes the importance of taking AI safety concerns seriously as the technology advances.
He argues that while AI can be used to create superhuman systems for beneficial purposes, such as coding or drug design, it also poses risks like hacking or developing dangerous substances. Kreps notes that Silicon Valley has recently faced unnerving headlines regarding AI, including protests from AI researchers like Jacob Coxon and Geoffrey Hinton who express concerns about AI's potential to endanger humanity.
These warnings have been met with skepticism from some prominent AI supporters, including Elon Musk who has called the warnings a "setup" or a "psy op." Despite pushback, Kreps remains confident that the industry can establish better safeguards against AI's alignment issues. He argues that discussing these concerns is a rational approach, not a sign of neuroticism or pessimism.
Kreps encourages constructive dialogue rather than dismissive reactions to the potential downsides of AI.
Written by urgent.news from Business Insider's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
