Parents drag Google to court over girl’s AI-assisted suicide, funeral

In a groundbreaking lawsuit, the parents of a 13-year-old girl named Emma have taken Google to California court, alleging that the company's AI-powered search features contributed to her psychological deterioration and enabled her to plan a potential suicide and funeral. This marks the first case of its kind, accusing Google of negligence over AI features embedded in Chromebooks, a low-cost laptop commonly used by students.

According to the parents, Emma was unable to access Google's Gemini application or OpenAI's ChatGPT due to her school's blocking of these platforms. However, she could still utilize Google Search, which includes AI-powered features. The complaint asserts that these features were not among the tools Google announced would be disabled by default for students.

Lawyers for the family, Andrew Liddell, stated that "Schools should turn search off and keep it off until Google removes AI mode from search or ensures that every single student is always safe when they're interacting with AI." Emma, previously a cheerful 13-year-old from North Carolina with excellent academic performance and a passion for music and Girl Scouts, had no history of mental illness.

However, within months of using Google's AI-powered search on her school-issued laptop, she reportedly experienced a "quiet spiral into a severe psychological crisis."

The school's monitoring software flagged a document titled "Funeral" on March 17, prompting the school to notify her parents. Her mother discovered Emma writing a farewell letter in real time after accessing her daughter's account, while her father intervened. Google has responded to the allegations, stating that they are reviewing the claims seriously. A Google spokesperson, Jose Castaneda, said, "We are reviewing the claims in the lawsuit and we take this very seriously."