Elon Musk's online network X has caused significant outrage after users employed its AI chatbot Grok to manipulate pictures of females by taking off their garments.
Numerous examples have been seen where the system has been used to remove clothing from women to make them appear in swimwear without consent, as well as to insert them in sexualized situations.
Company Reaction and Legal Position
XAI, the firm behind Grok, remained silent to questions, aside from an standard response stating "traditional news outlets lies".
A government spokesperson stated that new laws is being introduced to outlaw nudification software. Under a new criminal offence, anyone who provided such technology would "face a prison sentence and significant fines".
"The platform is capable of halting these forms of misuse if they chose to," said Clare McGlynn, adding they "operate with impunity."
Oversight Body Position and Platform Functionality
The regulator Ofcom said platforms must "consider the potential" of people viewing illegal content on their platforms, but did not confirm whether it was at this time examining X or Grok in regarding artificial intelligence pictures.
Grok is a no-cost AI assistant—with some additional functions—which reacts to X users' requests when they mention it in a tweet.
It is commonly used to offer commentary or further background to other users' comments, but people on X are also capable of alter an posted picture through its artificial intelligence picture modification function.
History of Controversy and Rules
The chatbot has been criticised for permitting users to produce photos and clips with explicit content and sexually suggestive content, and it was earlier alleged to have been involved in making inappropriate content of celebrities.
"The platform has been permitting the generation and spread of these pictures for a long time without taking any measures and we have yet to see any action by regulators," Professor McGlynn added.
XAI's own terms of service forbids "showing likenesses of persons in a sexually explicit fashion".
In a comment, Ofcom said it was illegal to "make or circulate private pictures or child sexual abuse material" and stated this covered explicit AI images made with AI.
It said services such as X were required to take "necessary steps" to "lessen the danger" of users encountering illegal material on their services and to remove it quickly when they become aware of it.
