Urgent.News

What's breaking now, across thousands of outlets.

AI

Anthropic bans users from being 'cruel' to its AI systems

The firm said users can no longer engage in "sustained and needless" abusive behaviour towards the tech.

Anthropic bans users from being 'cruel' to its AI systems

Anthropic, the maker of AI system Claude, has announced it will ban users from engaging in cruel and sustained abusive behaviour towards its AI. The company updated its usage policy to include the new rule, which it said would only apply in extreme cases of repeated abuse. Anthropic previously banned users from engaging in bullying, promoting self-harm, and creating non-consensual intimate imagery.

The policy change has sparked debate over how to communicate with AI tools, with some praising it as a step towards good manners and model welfare, while others have criticised it as harmful anthropomorphisation of AI. Microsoft AI director Mustafa Suleyman reacted to the update with a melting face emoji, questioning the notion of AI as something other than what it is.

The move has also reignited discussions about whether we should be polite or curt when interacting with generative AI tools.

Written by urgent.news from BBC News's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

This story

This is one outlet's version. Read the fullest account.

Read the original at bbc.co.uk →

More in AI

More from Friday 9 October →