Grok turns off image generator for most users after outcry over sexualised AI

The AI generator switched off except for those who pay to subscribe to X. Picture: Hans Lucas/AFP via Getty Images)

The highly criticised feature on Elon Musk-owned X that allowed users to create sexually explicit and violent imagery from real photos of women and children has been switched off for the vast majority of users.

It comes after a global outcry, and warnings from multiple jurisdictions, including Ireland, that X could face heavy fines for this use of the Grok AI tool on the X platform.

It had seen users granted the ability to ask Grok to alter images of women and children to remove their clothes and put them in sexualised positions.

This ability has now been switched off except for those who pay to subscribe to X, who must provide details such as card information when subscribing.

In a post on X, Grok said: “Image generation and editing are currently limited to paying subscribers.”

Politicians and advocacy groups had urged action after the feature went live towards the end of December, with commentary suggesting the creation of such images was illegal.

Under the European Digital Services Act, firms that breach the law can be fined up to 10% of global turnover. In the case of X, this could stretch into hundreds of millions of euro.

Taoiseach Micheál Martin called it “unacceptable” and “shocking”, while Tánaiste Simon Harris said that any Irish laws that need to be updated to crack down on the creation and sharing of explicit images will be implemented.

AI minister Niamh Smyth told RTÉ radio on Thursday that X was “breaking the law” by facilitating the generation of explicit images of women and child sexual abuse images (CSAM).

She added it is “at a point” now where enforcement action was required against X and Grok.

“I’ll certainly be doing everything I can to see that that does happen,” Ms Smyth said.

Ireland’s regulator Coimisiún na Meán, meanwhile, is liaising with the European Commission on the matter and has urged anyone with concerns over images that have been generated of them to report to An Garda Síochána. Reports can also be made to the Irish national reporting centre, Hotline.ie, it said.

Last month, the European Commission fined X over €100m following a lengthy investigation, including into its use of “deceptive” blue check marks.

Prior to the turning off of the feature, X said it was taking action against illegal content on the platform. “Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content,” it said.

However, given the feature was switched on, stretching well into the new year on the platform, it is unlikely that changing it now will deter probes into X at home and abroad.