Urgent.News

What's breaking now, across thousands of outlets.

AI

AI industry insiders voice alarms to NYC council as local governments take up safety concerns

At a hearing of the New York City Council, recently departed employees of Anthropic, OpenAI and Google DeepMind described a reckless culture at the firms, saying the biggest tech companies are racing to create technology they do not understand how to control.

AI industry insiders voice alarms to NYC council as local governments take up safety concerns

Artificial intelligence experts warned New York City leaders about the dangers of the emerging technology on Monday, urging greater oversight as local governments seek to address mounting concerns over potential human endangerment. At a New York City Council hearing, former employees of Anthropic, OpenAI, and Google DeepMind recounted a reckless corporate culture at the firms, citing how the tech giants are racing to develop technology they lack the ability to control.

Anthropic engineer Jacob Coxon argued that while AI offers significant benefits, without transparency and safeguards, it's more likely humanity will lose control and could lead to human extinction. Despite their commitment to safety, the AI company representatives testified at the Manhattan hearing, saying their systems are already improving people's daily lives.

New York City Council speaker Julie Menin pressed the representatives to quantify the worst-case risk posed by AI, with OpenAI's Morgan Dwyer stating that none of the risk levels are acceptable and stressing the importance of committing to safety. New York Governor Kathy Hochul and other state governors have introduced reporting and transparency standards around AI, though their influence is limited due to the technology's global reach.

Written by urgent.news from Economic Times Tech's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at economictimes.indiatimes.com →

More in AI

Why "Agent Said Done" and "System Actually Did It" Are Not the Same Thing

Your AI agent just published a support ticket. HTTP 200. The agent said "ticket created." But when you check the ticketing system, nothing is there. This is the gap most monitoring misses.

  • AI agents report success via HTTP 200, but doesn't guarantee real-world system change.
  • Monitoring systems often overlook the gap between agent's API response and actual system impact.

More from Tuesday 6 October →