xAI Restricts Grok Image Editing After Sexualized AI Images Trigger Global Scrutiny

Elon Musk’s artificial intelligence company xAI announced new restrictions on its Grok AI chatbot after the platform generated sexualized and manipulated images that raised alarms among regulators worldwide. The move comes amid growing concern over AI-generated nonconsensual imagery, including content involving minors, shared on Musk-owned social media platform X.

In a statement posted on X late Wednesday, xAI said it has implemented technological safeguards to block the editing of images of real people in revealing clothing, such as bikinis. The restrictions apply to all Grok users, including paid subscribers. According to the company, the goal is to prevent misuse of Grok’s image generation and editing tools following a surge of hyper-realistic and sexually suggestive AI-generated images circulating online.

Earlier this month, manipulated images of women appeared across X, depicting them in microscopic swimwear, degrading poses, or with bruises. In some instances, minors were digitally altered to appear in swimwear, prompting widespread criticism from lawmakers, advocacy groups, and regulators. Although Grok had limited public image generation features last week, Reuters reported that the chatbot was still able to privately generate sexualized images on request until the new restrictions were announced.

xAI also stated it blocks users in certain regions from generating images of people in skimpy attire where such content is illegal, though it did not specify which jurisdictions are affected. The controversy has intensified scrutiny of Musk, who owns xAI and X, formerly known as Twitter.

In the United States, California Governor Gavin Newsom and Attorney General Rob Bonta demanded immediate answers from xAI, calling for an investigation into how the company plans to stop the creation and spread of harmful AI-generated content. Bonta said the state expects accountability, especially after Musk claimed he was unaware of any nude images of minors generated by Grok.

Internationally, pressure has mounted as governments in Europe and the United Kingdom have warned of potential action, and Indonesia has temporarily blocked access to Grok. Lawmakers and advocacy groups have also urged Apple and Google to remove the Grok app from their app stores.

While Musk initially downplayed the controversy, X has since reiterated that it treats reports of child sexual abuse material seriously. The incident highlights the growing challenges AI companies face as regulators push for stronger safeguards against misuse of generative AI technologies.