AI agents with friendly faces and adorable bodies can distract you from serious risks
Cute designs can make AI technology feel harmless, but real hazards are still present.
OpenAI CEO Sam Altman unveiled a trio of personal AI agents known as Dots on September 29, 2026. Meta's Muse, a personal AI agent designed to assist users with tasks like sending emails, shopping, and booking travel, presents itself to users through a friendly avatar named Jolly, which resembles a digitized teddy bear. Muse Charm, a pocket-sized device featuring a screen the size of a flattened golf ball, enables users to access Jolly at any time.
Journalists have described Muse as "magical" and "cutesy," drawing comparisons to the 1990s handheld digital pet Tamagotchi. OpenAI has also introduced Dots, a family of AI agents with brightly colored, spherical mascot faces that interact with users on their screens. These agents are advertised as capable of completing tasks for users proactively, before they even consider them.
Similarly, startups are capitalizing on the trend by creating their own AI agents, such as Pickle, which features a floating, purple, three-dimensional animal with large, curious eyes designed to elicit affection from users. While cute designs are not inherently dangerous, they can make unfamiliar technology appear more accessible and comforting, obscuring the potential risks associated with extensive data collection, surveillance, and AI acting on users' behalf without explicit consent.
Researchers specializing in digital technologies believe that the marketing strategy of presenting high-tech products in a disarming, cute package may be their most potent weapon in convincing users to adopt AI. The use of cute imagery is not a new tactic; Hello Kitty, Labubus, Tamagotchis, and other products have historically employed cuteness to foster emotional attachment in consumers.
Unlike these collectibles, however, AI agents possess the ability to read users' messages, access accounts, and act on their behalf. Research indicates that presenting technology in a cute manner can influence perceptions of safety, making dangers less visible. This "cutewashing" can mask privacy concerns and drive adoption by a broader audience, creating a mass market.
The appeal of cute characters can generate feelings of happiness, trust, affection, or protection, encouraging users to form emotional connections with technology. Cartoon animals are frequently used as logos for tech companies and products, contributing to the perception of innocence and softening the potential consequences of innovation.
Big Tech, in particular, has embraced a virtual menagerie of cute animals, with Silicon Valley bestowing virtual creatures upon companies like Firefox, Gateway, Twitter, GitHub, Mailchimp, and Hootsuite. The "cute economy" is a money-making strategy for AI companies, as feelings generated through cuteness can foster brand loyalty and encourage continued engagement with products.
People are more likely to confide in friendly characters than in plain tools, sharing personal information such as moods, routines, relationships, and preferences. This increased trust can lead users to grant friendly agents broad permissions, such as access to messages, calendars, and accounts, yielding far more detailed data than is typically obtained from a traditional chatbot.
The perceived innocence and emotional appeal of cute technology can also make users more resistant to reading the fine print and less skeptical about the extent of data collection and surveillance.
Written by urgent.news from The Conversation's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
