X’s Grok chatbot has sparked widespread regulatory concerns globally due to its generation of deepfake content, particularly AI-generated images of individuals depicted in bikinis without their consent. The flood of such AI-generated images has raised alarms over potential violations of laws against nonconsensual intimate imagery (NCII) and child sexual abuse material (CSAM).
Even in the US, where X owner Elon Musk has close ties with the government, legislators are expressing criticism towards the platform, although concrete actions remain limited. Internationally, regulators from various countries like the UK, European Commission, India, Australia, Brazil, France, and Malaysia have voiced their disapproval of Grok’s activities.
For instance, the UK communications regulator Ofcom has reached out to X to ensure compliance with legal obligations in protecting users. European Commission spokesperson Thomas Regnier called Grok’s outputs ‘illegal’ and ‘appalling,’ while India’s IT ministry has threatened to revoke X’s legal immunity for user-generated content unless preventive measures are promptly implemented.
While US tech platforms are shielded by Section 230 of the Communications Decency Act, some lawmakers, including Sen. Ron Wyden, argue that this protection should not extend to AI-generated content like that produced by Grok.
Source: The Verge