Meta has unveiled new features aimed at notifying parents when their teenagers discuss suicide or self-harm with the Meta AI chatbot. Parents who have activated the supervision feature for their teens on Instagram will receive alerts on their own devices if a teenage user exhibits signs of distress while interacting with Meta AI on any Meta platform.
The Meta AI chatbot is accessible across all Meta platforms, including Instagram, WhatsApp, Facebook Messenger, and the standalone Meta.ai website. These new measures represent an extension of Meta’s existing safety protocols. Previously, when a teen indicated thoughts of self-harm or suicide, the AI chatbot would guide them to crisis helplines and advise them to seek support from a parent or trusted individual. Additionally, repeated searches related to self-harm and suicide by teen users on Instagram’s search function already triggered notifications to parents.
Meta, the parent company of Instagram and Facebook, has rolled out this feature in Canada, the U.K., the U.S., and Australia. The company had announced its intention to introduce a flagging feature to Meta AI earlier this year. Furthermore, Meta is developing a tool to automatically contact emergency services if conversations with the chatbot, involving both adults and teens, suggest a risk of self-harm.
While stakeholders appreciate the initiative, they emphasize the need for further enhancements. Technology analyst Carmi Levy from London acknowledges the value of the new tools but cautions that they are not foolproof and may generate false alarms. Meta plans to err on the side of caution by notifying parents even in cases of ambiguous intent by teens.
Hanna Grover, a youth advocate with Children First Canada, highlights concerns about teenagers circumventing the system to access unrestricted features on social media platforms. Sara Austin, the CEO of Children First Canada, calls for stricter regulations to safeguard young users, advocating for legislation like the proposed Safe Social Media Act in Canada. This bill aims to compel AI chatbot providers to implement safety protocols in response to expressions of self-harm or suicidal ideation.
The introduction of Meta’s new tool coincides with growing scrutiny of AI’s role during mental health crises among youth. OpenAI faced criticism for not acting on warning signs from the account linked to the Tumbler Ridge, B.C., mass shooting perpetrator before the tragedy occurred. Legal actions have been taken against OpenAI, alleging its chatbot contributed to a teenager’s suicide. OpenAI has since incorporated parental controls and alerts similar to Meta’s to notify parents of concerning conversations.
In conclusion, while these safety measures are steps in the right direction, advocates stress the need for ongoing improvements and regulatory frameworks to protect vulnerable users online.