Recent legal battles against deepfake porn highlight the ongoing struggle to combat non-consensual image manipulation online. An app named ClothOff has been causing distress for over two years, evading removal from major app stores and social platforms but remaining accessible through the web and a Telegram bot. Attempts to dismantle the app through legal action face hurdles, such as identifying the responsible parties scattered across different countries.
Professor John Langford, involved in a lawsuit against ClothOff, revealed the complexities of chasing down the app’s creators, believed to operate from the British Virgin Islands and Belarus. This case sheds light on the challenges posed by platforms facilitating non-consensual imagery generation, leaving victims with limited recourse for justice.
One striking example from the lawsuit involves an anonymous high school student in New Jersey whose Instagram photos were altered by classmates using ClothOff. The victim, underage when the original images were taken, faced the distribution of AI-modified content classified as child abuse imagery. Despite the clear illegality, prosecuting such cases proves difficult due to evidence collection challenges.
These incidents underscore the urgent need for technological solutions to combat deepfake content proliferation and safeguard individuals from image-based exploitation. The case serves as a cautionary tale, emphasizing the critical role technology plays in enabling and combating online image manipulation.
Source: TechCrunch