Anthropic bans users from being 'cruel' to its AI systems
The firm said users can no longer engage in "sustained and needless" abusive behaviour towards the tech.
Anthropic, the creator of the AI system Claude, has decided to ban users from being cruel to its AI tools. The company announced on Thursday that it would update its usage policy to prohibit sustained and unnecessary abusive behavior. This policy update comes after Anthropic's decision to ban the use of Claude for deceptive campaigns, and to clarify that it cannot be used for deceiving voters or disrupting elections ahead of the US midterm elections.
The policy change has sparked debate over how to communicate with AI tools. While Anthropic said the new policy would only apply in extreme cases of repeated abuse, it remains unclear what exactly Anthropic considers abusive or cruel behavior towards its models. Some experts argue that anthropomorphizing AI systems can lead to misconceptions about their capabilities.
Anthropic's move has drawn criticism from some quarters, with one expert suggesting that the policy could undermine abuse directed at humans and animals. The policy changes, first reported by The Verge, were made following an annual review of Anthropic's usage policy, and were also updated to address new or emerging risks in other areas.
Written by urgent.news from BBC Technology's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
