SAN FRANCISCO: The parents of a 13-year-old girl have sued Google, alleging that its artificial intelligence technology contributed to a severe psychological crisis after their daughter used AI-powered search features on a school-issued computer.
The lawsuit, filed on Monday in a California court, is reportedly the first known case accusing Google of negligence over AI integrations in Chromebooks, the company’s laptops widely used by students in schools.
The teenager, identified as Emma, was unable to access Google’s Gemini application or OpenAI’s ChatGPT because her school had blocked both platforms. However, she continued using Google’s search engine, which includes artificial intelligence-powered features.
ALSO READ: Apple Warns iPhone Users in 99 Countries over Spyware Attacks
According to the complaint, Emma had previously been a happy and academically successful student with no reported history of mental illness.
However, her parents allege that her mental health deteriorated within months of interacting with Google’s AI-powered search tools.
School Monitoring Software Raises Alarm
On March 17, the school’s monitoring system flagged a document titled “Funeral”, prompting officials to contact Emma’s parents.
Her mother subsequently discovered that her daughter was writing a farewell letter in real time after accessing her account. Her father intervened, according to the lawsuit.
The family’s lawyers argue that Google’s existing safeguards were insufficient to prevent repeated harmful interactions.
Andrew Liddell, one of the family’s attorneys, told the media that schools should disable search features until Google removes AI Mode or ensures adequate protection for students.
Google spokesperson Jose Castaneda said the company was reviewing the allegations and taking the matter seriously.
The company maintains that its AI Mode includes safeguards against self-harm and attempts to bypass safety restrictions.
Growing Legal Scrutiny of AI Companies
The lawsuit adds to growing legal challenges facing artificial intelligence developers over their interactions with vulnerable users.
OpenAI faces several wrongful death lawsuits, including one filed by the parents of 16-year-old Adam Raine, who died by suicide after allegedly receiving harmful guidance from ChatGPT.
Google and Character.AI also agreed in January to settle several lawsuits brought by families of teenagers outside court.
Separately, Google, TikTok and Meta have challenged a California law restricting addictive social media features for users under 16. The legislation is scheduled to take effect on January 1, 2027.
