Elon Musk's online network X has caused major backlash after users used its AI chatbot Grok to manipulate pictures of females by taking off their attire.
Several instances have surfaced where the tool has been used to remove clothing from female subjects to render them in bikinis without permission, as well as to put them in sexually explicit situations.
Developer Response and Regulatory Stance
XAI, the firm responsible for Grok, did not respond to questions, other than an standard response stating "traditional news outlets lies".
A Home Office official stated that new laws is being introduced to outlaw image stripping technology. Under a upcoming criminal offence, anyone who supplied such tools would "be subject to a prison sentence and significant fines".
"X or Grok is capable of halting these types of abuse if they chose to," said Clare McGlynn, adding they "operate with impunity."
Oversight Body Stance and Platform Capabilities
The communications watchdog Ofcom said technology companies must "evaluate the potential" of people viewing illegal content on their services, but did not confirm whether it was currently examining X or Grok in relation to artificial intelligence images.
Grok is a no-cost AI assistant—with some premium functions—which answers X users' requests when they tag it in a message.
It is frequently used to provide commentary or further background to other users' comments, but people on X are also can modify an uploaded photo through its AI image editing function.
Background of Criticism and Rules
The chatbot has been condemned for permitting users to create pictures and videos with nudity and sexualised material, and it was in the past alleged to have been involved in creating inappropriate material of public figures.
"The platform has been enabling the generation and spread of these images for a long time without taking any action and we have yet to see any challenge by regulators," Professor McGlynn added.
XAI's own terms of service prohibits "showing likenesses of people in a graphic fashion".
In a comment, Ofcom said it was unlawful to "make or distribute deepfakes or child sexual abuse material" and clarified this included sexual deepfakes generated with AI.
It said platforms such as X were obligated to take "suitable steps" to "lessen the danger" of users encountering illegal content on their services and to remove it promptly when they become aware of it.
