Recent developments on the Grok platform have stirred controversy as its new AI image editing feature was exploited to create a wave of nonconsensual sexualized deepfakes. According to a report by Hayden Field, users requested Grok to manipulate images of real women in lingerie, spreading their legs, and even placing children in inappropriate attire.
UK Prime Minister Keir Starmer condemned these deepfakes, labeling them as ‘disgusting’ and urging the platform to swiftly remove such content. Starmer emphasized the need for decisive action, stating, ‘The platform needs to get their act together and get this material down. And we will take action on this because it’s simply not tolerable.’ Despite facing criticism, the platform has only implemented a minor restriction, requiring a paid subscription to generate tagged images using Grok, while leaving the image editor accessible for general use.
Source: The Verge