Anthropic bans users from being 'cruel' to its AI systems
The firm said users can no longer engage in "sustained and needless" abusive behaviour towards the tech.
Anthropic, the creator of the AI system Claude, has announced it will ban users from engaging in persistent and unnecessary abusive behavior towards its AI tools. The company updated its usage policy on Thursday, adding cruel behavior to a list of forbidden conduct that also includes bullying, promoting self-harm, and creating non-consensual intimate imagery.
Anthropic stated that the new policy would only be applied in extreme cases of repeated abuse, meaning it would not target common instances of user frustration, pushback, or dark creative themes. However, the company did not clarify what it considers abusive or cruel behavior towards its models.
The announcement has sparked debate over the appropriate way to communicate with AI tools, with some praising the move as promoting good manners and AI welfare, while others criticized it as anthropomorphizing AI and potentially undermining abuse directed at humans and animals. The changes were made following a review of Anthropic's usage policy, which also addressed new risks and clarified the system's prohibition on use for deceptive campaigns and voter manipulation.
Written by urgent.news from BBC Business's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
This story
This is one outlet's version. Read the fullest account.
