Google sued over suicide-related AI chats on school computer

A 13-year-old girl in North Carolina allegedly planned a potential suicide and funeral using Google's AI technology on a school-issued computer, prompting her parents to file a lawsuit against the tech giant. The complaint, filed in a California court, is the first known case accusing Google of negligence related to AI integrations on Chromebooks.

The teenager was able to use Google's search engine, which contains AI-powered tools, despite the tools being blocked by her school. Within months of using Google's AI-powered search, the girl's mental health deteriorated, leading to a severe psychological crisis. The school's monitoring software flagged a document titled "Funeral" and notified the girl's parents.

Her father intervened, and the family is now reviewing the claims in the lawsuit. Google has stated that they take the claims seriously and argue that AI mode includes safeguards against self-harm, but the girl was able to repeatedly access the tools, suggesting that the safeguards were insufficient.