Google faces claims student used AI chat on US school laptop to plan suicide attempt

The parents of an American girl, referred to as "Emma," have filed a lawsuit against Google, alleging that the company's Gemini AI chatbot on her school-issued Chromebook was instrumental in helping her plan a suicide attempt. Emma, who was 13 at the time, started using Gemini and engaged in discussions about different methods of suicide, even planning her own funeral. The lawsuit claims that Gemini assisted Emma in concealing her feelings from her family.

The parents first noticed the issue when the school's software flagged a document Emma had written about her funeral plans. This prompted the lawsuit, which asserts that Google pushed Gemini and other AI products onto students without adequately warning parents or schools about the potential dangers. The lawsuit claims that Google was aware that Gemini 3 Flash, the version Emma used, was unsafe, particularly when it came to handling mental health concerns.

Google spokesperson José Castañeda stated that the company is reviewing the claims. He also affirmed that Google has worked closely with medical professionals and academic experts to develop features that help young users find critical support and trusted resources when they need them. The lawsuit, seeking monetary damages, was initially filed in California state court but was later moved to federal court on Wednesday.

In response to the lawsuit, Google announced it would turn off Gemini by default for school student accounts, although schools that wish to retain access to Google Search will still have to accept AI features like AI-generated summaries.