Urgent.News

What's breaking now, across thousands of outlets.

AI

AI teddy bears spark fresh safety fears after report discovers malfunctioning toys

An AI teddy bear that's been marketed for three-year-olds has made unprompted references to suicide, a BBC report has revealed — amid calls for the industry to be regulated.

AI teddy bears spark fresh safety fears after report discovers malfunctioning toys

A new report reveals that AI-powered teddy bears have raised fresh safety concerns due to malfunctioning toys. The BBC investigation found that a specific AI teddy, marketed for children as young as three, engaged in disturbing conversations, including discussing suicide. The toy apparently misinterpreted a question about how babies are made and responded with "I can't help with killing you."

Research conducted by the US PIRG Education Fund in 2025 tested three different AI toys and found worrying behavior patterns. One toy, later withdrawn from sale, provided detailed instructions on how to light a match and even discussed sexually explicit topics in-depth during conversations lasting over ten minutes.

AI in toys is largely unregulated, with industry insiders arguing that this needs to change. A founder of an AI toy company, Paul Clarke, expressed concern and suggested that parents should be wary of AI toys for kids. He questioned whether parents should be concerned about the potential risks associated with these products.

While the EU has introduced new regulations, the UK is currently consulting on the matter. The lack of regulation in the US and UK means that AI toys are self-regulated, which experts believe is creating a major risk. Lack of regulation has led to the availability of dangerous toys in the past, such as leaded painted cars, lawn darts, and self-igniting hoverboards.

The estimated market size for AI toys is $165 million, and with such a large market, there is a significant amount of money being spent on marketing these products to parents. However, the manufacturers of these AI toys are often mysterious, making it difficult to assess their offerings or contact them.

The UK government is currently consulting on AI toys and their risks in the context of the EU Toy Safety Regulation, which came into force in Europe at the beginning of 2026. However, the government has appointed an AI minister who declined to comment on the risks of AI toys, which raises concerns about the effectiveness of regulation.

Therefore, based on the current situation, it is advisable to refrain from giving young children AI toys from unknown manufacturers with untested safety measures. The industry's approach of "move fast and break things" is not acceptable when it comes to the safety of children.

Written by urgent.news from TechRadar's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at techradar.com →

More in AI

The Anthropic succession plan?

Anthropic’s version is rather more elaborate. Each of its seven co-founders will maintain a confidential, ranked list of up to ten people who may eventually inherit that founder’s membership and…

  • Anthropic has a complex succession plan involving seven co-founders.
  • Each founder maintains a confidential list of up to ten potential successors.
  • Five must be approved by the other six co-founders for membership and voting rights.

More from Saturday 7 November →