Google DeepMind launches institute to widen the AGI debate
Google DeepMind just launched an institute to hash out the big AGI questions in public
Google and DeepMind's DeepMind Institute was established on Wednesday to broaden the dialogue surrounding artificial general intelligence (AGI). Key figures leading the institute include DeepMind co-founder Shane Legg, Google executive James Manyika, and DeepMind chair Demis Hassabis, with Legg also serving as managing editor. The institute's goal is to explore contrasting perspectives between Google, DeepMind, and the larger global research community concerning AGI.
The institute's first set of four essays presents various viewpoints on AGI-related matters. Topics range from economic policies for managing potential disruptions caused by AGI to preserving human-readable model reasoning, establishing principles for human flourishing, and a framework for evaluating advanced AI models. One essay, co-authored by DeepMind safety researchers Rohin Shah and Anca Dragan, posits that AI's diminishing transparency window—its ability to provide step-by-step reasoning—may not be an unavoidable outcome.
As newer architectures make the most powerful models harder to monitor, the authors argue that developers and regulators should openly discuss the safety trade-offs. Strategies could involve limiting "opaque serial depth" or mandating developers to demonstrate that less transparent systems still offer comparable monitorability.
Hassabis suggests the creation of a U.S.-led frontier AI standards body to assess the most advanced AI models. Under his plan, developers would initially submit their models for voluntary review at least 30 days before deployment. If the evaluation system proves effective, passing its tests could be required for releasing frontier models in the United States.
Initially, the body would design assessments in collaboration with AI companies, but would eventually develop independent, undisclosed evaluations—known as "held-out" tests—to prevent model tweaking based on known evaluations. Hassabis believes the framework could be expanded if the severity of the situation warrants, potentially including a coordinated slowdown by frontier AI developers.
These essays come at a time when the industry's safety debate is transitioning from general concerns to concrete proposals for disclosure, external scrutiny, and coordinated slowdowns if safeguards falter. This shift gained momentum this week as industry leaders backed elements of Anthropic CEO Dario Amodei's call for "pace" in frontier AI development.
Written by urgent.news from TechCrunch's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
