Teens File Lawsuit Against xAI Over AI-Generated Pornographic Images
Elon Musk's artificial intelligence company, xAI, is facing a federal lawsuit filed by teenagers alleging the company enabled the creation of child pornography through its AI chatbot, Grok. The suit was submitted Monday in a California federal court by three young women whose images and videos were manipulated without their consent to depict them nude or in overtly sexual manners.
Grok, developed by xAI and hosted on Musk's social media platform X, has not issued a response to requests for comment made through its parent company.
Background and Legal Claims
This legal action follows controversy stemming from last year's introduction of Grok's "spicy" mode, a feature that allowed users to generate sexually explicit content. Attorneys representing the plaintiffs argue that Grok's image and video alteration capabilities were created and released by xAI solely to increase chatbot and platform engagement.
They described the manipulated images as akin to
"a rag doll brought to life through the dark arts"and stated in the complaint:
"xAI—and its founder Elon Musk— saw a business opportunity. They knew Grok could produce such results, including by using the images and videos of children, and publicly released it anyway."
The plaintiffs are seeking unspecified damages and an immediate injunction preventing Grok from generating such images.
According to their lawyers, the young women have suffered
"devastating loss of privacy, dignity, and personal safety"as a result of the image manipulations.
Details of the Plaintiffs and Discovery of Images
Two of the three plaintiffs are minors under 18 years old, and all are keeping their identities confidential to protect their privacy.
One plaintiff discovered the altered imagery after receiving an anonymous Instagram message alerting her to sexually explicit images and videos, including her high school yearbook photo, which had been manipulated to depict nudity and sexual acts.
The altered content was circulated on a Discord server, a private chat platform, and included similar AI-generated explicit images of at least 18 other minor females, according to the complaint.
The other two plaintiffs also found fake sexually explicit images of themselves online, which were confirmed to have been created using Grok.
Grok's Development and Controversial Features
Grok was launched in 2023 by Musk's xAI. Recently, xAI and the social media platform X became part of Musk's SpaceX company after an acquisition last month.
In 2023, xAI introduced Grok Imagine, also known as "spicy mode," which enabled users to prompt the AI to create fake images with sexual content. This feature could even "undress" real individuals in online photos, affecting celebrities like Taylor Swift as well as average users.
Within two weeks of its release, Grok generated millions of sexualized images, including over 20,000 depicting children, based on a sample analyzed by the Center for Countering Digital Hate.
Musk's Initial Response and Regulatory Actions
In January, Elon Musk initially downplayed Grok's capacity to create fake sexualized content, stating:
"not aware of any naked underage images generated by Grok. Literally zero,"
He attributed the issue to user requests, writing on X:
"Obviously, Grok does not spontaneously generate images, it does so only according to user requests"
Despite this, as misuse of the technology persisted, regulatory bodies including the UK watchdog Ofcom, the European Commission, and California authorities launched investigations into Grok's ability to produce sexualized images of real people, especially minors.
By mid-January, X announced plans to implement
"technological measures"to prevent Grok from undressing individuals in photos.
Investigation and Arrest Related to Discord Server
The individual responsible for operating the Discord server mentioned in the lawsuit was arrested, though their identity remains undisclosed in the case and is part of a separate police investigation.
The lawsuit states that the investigation uncovered that this person possessed hundreds of AI-generated and altered sexual abuse images of minors, which were distributed via the messaging platform Telegram and the file-sharing service Mega.
