San Francisco Orders Meta to Stop ‘Allowing’ AI Child Abuse Ads

San Francisco’s city attorney has sent a cease-and-desist letter to Meta, highlighting the company’s inability to prevent child exploitation on its platforms. The revelation that more than 350 ads included AI-generated child sexual abuse content, some of which had been uploaded multiple times and reached over 29,000 accounts across several countries, is a disturbing testament to Meta’s failures.

This issue is not unique to Meta. Researchers at the Tech Transparency Project (TTP) have consistently found thousands of ads on Meta’s platforms that direct people to harmful apps and contain explicit content. The tech industry as a whole has struggled to detect and address potential child sexual abuse in advertising. Even when reports are made about abusive ads, they often take weeks or more for Meta to respond, during which time hundreds of people may be exposed to the content.

The city attorney’s letter raises questions about how Meta’s ad policies and safety systems operate. The company claims to have zero tolerance for child exploitation, but the scale and persistence of these issues suggest otherwise. In some cases, ads were not marked as containing child sexual abuse content even after being removed.

Meta has profited from these ads while claiming to have zero tolerance for child exploitation. This highlights the tension between profit and social responsibility in the tech industry. The city attorney’s letter is a wake-up call for Meta and the broader tech industry. It’s time for companies like Meta to take responsibility for their role in enabling child exploitation and to work towards creating systems that truly prevent harm.

The stakes are high, and the consequences of inaction will be dire. As Katie Paul, director of the Tech Transparency Project, notes, “Meta has claimed it takes a hard stance against child sexual abuse material, but since our September 8 report published, more brand-new ads containing CSAM have appeared on its platform.” This suggests that Meta’s efforts are woefully inadequate and that the company needs to overhaul its systems and policies.