Urgent.News

What's breaking now, across thousands of outlets.

AI

The Pope’s AI Guy Is Worried About ‘Cartel’ Behavior Among Big Labs

Paolo Benanti tells WIRED that hysteria over whether godlike AI could destroy humanity is distracting from the need for public debate about how to govern the technology.

The Pope’s AI Guy Is Worried About ‘Cartel’ Behavior Among Big Labs

Father Paolo Benanti, a Catholic priest advising the Church on AI, warns that excessive focus on superintelligence distracts from the need for open debate on how to regulate the technology. He argues that the big labs, seeking to maintain their market positions, exclude others from the conversation by making the problem seem too complex for anyone else to solve.

Benanti advocates for democratic regulation and democratic regulation, stating that ethics should not be confined to a company's board of trustees but should be debated publicly. He advocates for mandatory third-party evaluations of AI models and opposes recursive self-improvement, fearing it could lead to the technology slipping out of human control.

Benanti criticizes the labs for behaving like a cartel, dictating industry rules and excluding all others. He questions the framing of superintelligence as something divine, arguing it skews the discourse and distracts from the mathematical reality. Benanti believes the advent of AI could create a new role for religions in public debate, urging the Church to engage with the technology in service of the common good.

Written by urgent.news from Wired Business's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Also reported by 1 other outlet

Read the original at wired.com →

More in AI

Optimal liability for offensive and defensive AI

How much liability should AI providers bear when their services enable both attack and defence? Liability can improve welfare while increasing harm.

  • Liability for AI services is complex, balancing offense and defense.
  • Overly strict liability weakens defense and boosts attacker profits.
  • High liability can lead to universal guarding in pure equilibrium.

Text-to-SQL in Practice: When to Trust AI Output and When to Gate It

AI assistants are now a normal part of SQL work. You describe what you need, get a query back in seconds and move on. The problem is not that these queries fail. Most of the time, they run perfectly.

  • 84% of developers use or plan to use AI tools for text-to-SQL tasks
  • 46% distrust AI output accuracy, 33% trust it
  • Implement risk-tiered workflow and guardrails for AI-assisted SQL queries

More from Wednesday 23 September →