NYC Lawmakers Aim to Lead Nation in Establishing AI Safety Rules

New York City is stepping up as a potential leader in setting AI safety rules, according to the Wall Street Journal's report on Oct. 5. The New York City Council held a hearing on Monday where representatives from OpenAI, Anthropic, Meta, and Google, as well as former AI company employees, were questioned and challenged by council members.

The hearing came as the council is contemplating several bills to regulate AI. Among these are a city-run 'kill switch' for AI, whistleblower protections, and limitations on AI usage in public schools. City Council Speaker Julie Menin emphasized that New York's bills could serve as a national benchmark and warned against the notion that AI could self-regulate.

Menin probed AI executives about potential worst-case scenarios, and representatives from OpenAI, Anthropic, and Meta all expressed support for AI safeguards, including third-party evaluators. Menin also questioned the executives about remarks made by OpenAI CEO Sam Altman, who suggested that society should be prepared for potential negative outcomes alongside the benefits of AI.

OpenAI's head of policy development and operations, Morgan Dwyer, responded that while some AI risks are unacceptable, it's crucial to make the technology accessible to more people to maximize its benefits. The council announced the hearing in a Sept. 28 statement, noting that most companies only agreed to appear after the council threatened to subpoena them.

The council is also contemplating a whistleblower incentive scheme, a private right-of-action for New Yorkers harmed by AI agents, and other AI-related bills. Menin stressed that given the seriousness of the matter, these firms should appear before the council, answer their questions under oath, and provide input on their proposed legislation.