Is Mark Zuckerberg's cute new AI assistant a surveillance trap? Why child safety experts are sounding the alarm over Meta Muse

Meta's Muse AI assistant, a new addition to the company's suite of social media products, has stirred controversy among child safety experts. The AI agent, initially launched in the US and Canada, is designed to carry out tasks on behalf of its users, such as online shopping and booking trips. However, the device's design, featuring a customizable, cuddly avatar named Jolly, is raising concerns among those who believe it could serve as a surveillance tool.

The device, Muse Charm, is a wearable charm that houses the AI agent and boasts features like an OLED touchscreen, front and rear cameras, microphones, speakers, 5G connectivity, and USB-C charging. The charm's adorable design, which allows users to personalize its appearance and voice, is seen as a psychological trap that could make children and teenagers feel compelled to keep the device close, despite potential privacy risks.

Child safety advocates argue that the always-on feature and its potential to read private correspondence, access financial accounts, and autonomously execute transactions could lead to severe privacy breaches. Critics also point out that Meta's use of a cute, child-like design to attract younger demographics is a deliberate attempt to gain access to vulnerable users.

While Meta maintains that the avatar customization is meant to bring users joy, child safety advocates dismiss these safeguards as unenforceable, claiming that app-level age gates will not deter young people desperate to use a viral, pocket-sized companion.