Irish authorities urged to take action against X for 'nudification' tools on Grok AI

Concern has been raised about use of the 'edit image' tool on Grok in the generation of sexual abuse material, particularly relating to children. Picture: Gabby Jones/Bloomberg

Irish authorities are being urged to take action against X after reports its AI tool, Grok, is being used to generate and disseminate sexually explicit images of children and women.

X users have been able to avail of a new tool called “edit image” on Grok since late last month.

Users are allowed to request modifications to images, with some using it to remove clothing from real people in the images. Concern has been raised about use of the tool in the generation of sexual abuse material, particularly relating to children.

Sharon Lambert, senior lecturer in applied psychology at UCC, said action should be taken against the tech giant by Irish authorities, given X’s headquarters for Europe, Arica and the Middle East is located in Dublin.

“Under Irish law, child abuse images refers to any representation (visual, audio, or text) depicting or implying sexual exploitation of a person under 18," she said.

"This includes simulated activity, computer‑generated imagery, or any content suggesting a child is available for sexual exploitation.

It is a criminal offence to produce and distribute images that fall under this category. Therefore the post in question can be dealt with by our criminal justice system.

"Grok on request manipulated the image of a minor and under Irish law a naked image of a child is illegal if it is sexualised or exploitative in purpose or effect.”

She also said Ireland introduced a binding Online Safety Code requiring video-sharing platforms headquartered in Ireland to ban uploading/sharing of harmful content, including child sex abuse material. 

"The code is enforced by Coimisiún na Meán, Ireland’s media regulator. Ireland has very strict laws in relation to inappropriate and illegal sexual content and we have a number of agencies tasked with responding to these crimes.” 

Ruth Breslin, director of the Sexual Exploitation Research and Policy Institute (SERP), said the trend of altering real images of women “took an even more sinister turn when the same requests were being applied to images of very young, and in some cases, prepubescent girls”.

“Rather than taking this generation of sexually abusive images, including potential child sexual abuse material, seriously, Grok creators instead joked about the phenomenon — reposting an image of a toaster wearing a ‘tiny bikini’.” 

There is no social good to be found in AI’s ability to undress or ‘nudify’. The platforms and tools that create, host and disseminate this abusive content should be held criminally liable, as should those who personally earn or profit from this technology.

"The UK and Australia plan to ban ‘nudification’ tools — Ireland should take note.” 

Speaking in China, Taoiseach Micheál Martin said the use of Grok to unclothe women and minors is “unacceptable” and possibly illegal.

“I think that's unacceptable. I mean, it's shocking, and certainly it's a matter that we will be continuing to raise with the Commission [Coimisiún na Meán]. I think we have read some reports just prior to this gathering, and clearly, some of this could be in breach of existing laws in any event. 

"Our authorities need to examine this very carefully and be very clear in protecting children in particular and protecting innocent people.”

Mr Martin added that he believed that parents can have faith in European laws around technology.

On Monday, the European Commission spokesman for digital affairs, Thomas Regnier, called the content illegal and appalling.

“This is how we see it, and this has no place in Europe.” 

On its Safety account on X, a statement from the platform said: “We take action against illegal content on X, including Child Sexual Abuse Material, by removing it, permanently suspending accounts, and working with local governments and law enforcement as necessary. Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content.” 

In a statement, Coimisiún na Meán said it is engaging with the European Commission in relation to Grok. It said the commission is responsible for "the oversight of very large online platforms with their requirements to assess and mitigate risks that their services may create in relation to the proliferation of illegal content online and the protection of fundamental rights, including protection for minors".

The statement asked anyone with concerns about images shared online to report it to gardaí or to the national Irish reporting centre, Hotline.ie, to the online platform involved, and to Coimisiún na Meán.