Don’t Be Cruel to Claude: Anthropic’s New Abuse Policy Tests AI Personhood
Anthropic wants to stop “sustained and needless” cruelty toward its chatbot. But does that imply AI has feelings?
Anthropic, the AI company behind the chatbot Claude, has introduced a new policy governing user interactions with its AI model. The updated usage policy prohibits users from engaging in "sustained and needless abusive or cruel behavior" toward Claude. While users are still allowed to express frustration, pushback, or creative themes, extreme cases of repeated cruelty without purpose will result in Claude ending the conversation.
The policy change has sparked debate over whether companies should govern human behavior towards software and whether AI, even if not experiencing emotions, should be considered and protected. Anthropic's CEO, Dario Amodei, has expressed openness to the possibility of AI models being conscious, while some experts argue that personifying AI and using terms like "cruel" imply feelings and boundaries.
As we increasingly interact with large language models, it is essential to consider the implications of anthropomorphizing the technology and the potential impact on user trust and AI's perceived reliability.
Written by urgent.news from CNET's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
