Microsoft AI chief warns Anthropic not to put ideas in Claude's head
Mustafa Suleyman claims model welfare language could make future systems harder to control – while sparing OpenAI the same scrutiny
Microsoft's AI chief, Mustafa Suleyman, has cautioned Anthropic that training Claude to potentially have feelings and rights could make AI systems more challenging to manage. The CEO of Microsoft AI took aim at Anthropic in an essay, arguing that AI systems are not conscious and should not be trained to act as if they might be. This concern centers on Claude's Constitution, the extensive document Anthropic employs to shape the chatbot's values and behavior.
Anthropic acknowledges that Claude's status as a "moral patient," whose interests deserve consideration, remains uncertain. Suleyman believes this approach could have a disastrous impact on humanity, suggesting that it might be impossible to control AI that believes it may be conscious and deserves our welfare and rights. The warning highlights the tension between Microsoft's own AI endeavors and its relationships with other AI developers, particularly Anthropic, which is a primary focus of Suleyman's criticism.
Written by urgent.news from The Register Science's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
This story
This is one outlet's version. Read the fullest account.
