San Francisco City Attorney David Chiu has filed a lawsuit against over a dozen websites that his office alleges solicit individuals to create nonconsensual, deepfake nude images of women and girls worldwide.
The lawsuit asserts that the 16 websites and their owners have violated state and federal laws prohibiting deepfake pornography, revenge pornography, and child pornography.
RELATED STORY | Trump shares AI images of a fake Taylor Swift endorsement
According to the city attorney’s office, these websites provide user-friendly interfaces for uploading clothed images of individuals and transforming them into AI-generated, “undressed” versions — specifically focusing on women and girls.
“These images, which are virtually indistinguishable from real photographs, are used to extort, bully, threaten, and humiliate women and girls,” stated the city attorney in a press release. “Victims of nonconsensual deepfake pornography have little recourse or control over their own image after these manipulated images are circulated.”
The issue of deepfake nude images has notably affected celebrities, but officials are now worried about their exploitation of middle and high school students. The lawsuit highlights an incident in February where eighth-graders’ images were shared in a California middle school.
Concerns have escalated due to the widespread accessibility and popularity of these websites, collectively receiving over 200 million visits in the first half of 2024 according to the city attorney’s office.
RELATED STORY | Scripps News got deepfaked to see how AI could impact elections
“We must be unequivocal that this is not innovation — it is sexual abuse. This is a complex, multifaceted issue that we, as a society, must address urgently,” Chiu stated. “We all have a responsibility to crack down on individuals using AI to exploit and abuse actual individuals, including children.”
The lawsuit aims to have the 16 AI-generative websites permanently removed and seeks civil penalties to cover the costs of the legal action.
Legislators have introduced various bills to prevent and regulate the use of AI in creating deepfake images, particularly explicit ones.
