Meta to Alert Parents of Teens Discussing Self-Harm in AI Chats

Meta has announced that parents will now receive alerts if their teenagers discuss suicide or self-harm within the company’s artificial intelligence chat service. The update applies to users of Facebook and Instagram who have parental supervision settings enabled, marking an expansion of the company’s existing safety protocols.

Expanding Parental Oversight

The new policy builds upon a previous announcement from February, in which Meta stated it would notify parents if teenagers repeatedly searched for terms related to self-harm or suicide. By extending this to Meta AI, the company aims to keep parents informed if their children appear to be in distress.
These alerts are currently live in the United States, the United Kingdom, Australia, and Canada. Meta plans to make the feature available globally by the end of the year.

Manual Review and Safety Protocols

Meta acknowledged that receiving such notifications can be distressing for parents. To manage this, the company stated that all chats flagged by its AI will undergo a manual review process before an alert is sent.
The company noted that it intends to "err on the side of caution" when making these decisions. While Meta admitted that this approach might occasionally result in notifications where there is no actual cause for concern, it maintains that this is the correct starting point for its safety efforts.

Concerns from Safety Advocates

The Molly Rose Foundation, an organization established in memory of 14-year-old Molly Russell, has expressed reservations regarding the new policy. Chief executive Andy Burrows warned that the alerts could cause panic among parents and argued that the company should prioritize addressing the safety issues inherent in its products.
Burrows stated that the move forces disclosures on young people at a time when they should be offered expert support. He emphasized that if Meta is to implement such a system, it is crucial that robust support is in place to help parents navigate the sensitive conversations that may follow an alert. The foundation continues to assert that Meta’s platforms contribute significantly to online risks regarding self-harm and suicide.