UK Regulator Warns Snapchat’s My AI Over Privacy Risk

According to a recent update by the regulator, Snapchat has received a warning from the UK’s data regulator regarding its new artificial intelligence (AI) chatbot, “My AI.”

The U.K. Information Commissioner’s Office (ICO) issued a preliminary notice to Snap Inc. and Snap Group, Snapchat’s parent companies, on October 6 for the potential failure to “properly assess the privacy risks” posed by the chatbot.

The notice is based on a preliminary investigation of the company conducted by the watchdog, which concluded that the risks to several million My AI users, including minors aged 13 to 17, were not adequately identified before the product’s release.

The U.K.’s information commissioner, John Edwards, commented on the notice, stating:

“We have been clear that organizations must consider the risks associated with AI, alongside the benefits. Today’s preliminary enforcement notice shows we will take action in order to protect U.K. consumers’ privacy rights.”

According to the notice, if a final enforcement notice is issued, Snap may be required to cease data processing about My AI, which would prevent it from offering the service to U.K.-based users without an “adequate” risk assessment.

The ICO has stated that a conclusion should not be drawn at the current stage of the investigation. In February 2023, Snapchat rolled out its AI chatbot to Snapchat+ users in the United Kingdom, with wider availability commencing in April 2023.

“We will continue to work constructively with the ICO to ensure they’re comfortable with our risk assessment procedures.”

My AI is powered by OpenAI’s GPT-4 technology and, according to the UK’s data watchdog, is the “first instance of generative AI embedded into a major messaging platform.”

“My AI went through a robust legal and privacy review process before being made publicly available,” according to the spokesperson.

Major social media platforms have integrated AI features into their operations throughout the year.

LinkedIn, a business-focused social media platform owned by Microsoft, announced the availability of additional AI tools for recruiters and an AI assistant in its learning center on October 4.

Meta, the parent corporation of Facebook and Instagram, and Google have both announced AI chatbot integrations for their respective services.