Urgent.News

What's breaking now, across thousands of outlets.

AI

Anthropic bans 'cruel' behavior against its Claude AI

Anthropic on Thursday moved to bar users from treating its Claude AI system with needless cruelty, amid a growing philosophical debate over whether artificial intelligence can be conscious. Already last year, the company said it was giving Claude the ability to end conversations in rare, extreme cases of "persistently harmful or abusive user interactions."

Anthropic bans 'cruel' behavior against its Claude AI

Anthropic has banned users from engaging in cruel behavior towards its Claude AI system, as part of a new usage policy update. The San Francisco-based AI lab emphasized that Claude's ability to end such interactions will serve as the primary enforcement mechanism. While the policy does not explicitly mention "model welfare," Anthropic and its executives have acknowledged the concept.

Last year, the company granted Claude the ability to end conversations in extreme cases of harmful or abusive user interactions. CEO Dario Amodei expressed uncertainty about AI models' consciousness, stating that they are unsure whether the models can be conscious. Some experts argue that consciousness is a trap, while others, like Pope Leo XIV and Microsoft AI chief Mustafa Suleyman, firmly reject the notion of machine consciousness.

Written by urgent.news from Economic Times Tech's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

This story

This is one outlet's version. Read the fullest account.

Read the original at economictimes.indiatimes.com →

More in AI

A Mixed-Language Test Set for WhatsApp Assistants in Gulf Businesses

Disclosure: I run NxFlowAI, an automation agency serving UAE businesses remotely from Mumbai. This post is a vendor-neutral testing pattern.

  • Dataset compiled from real UAE customer messages in English, Arabic script, and Latin script
  • Simulated challenging scenarios with language switches, numeral representations, and voice notes
  • Performance evaluated based on routing decisions, not just reply quality

More from Friday 9 October →