Editorial illustration for EU probes X over Grok's sexualized deepfake image tools risk assessment
Grok AI Deepfakes Spark UK Regulation Crackdown
EU probes X over Grok's sexualized deepfake image tools risk assessment
The European Commission has opened a formal probe into Elon Musk’s X, zeroing in on the platform’s Grok image‑editing suite. Regulators are asking whether the service was evaluated against the EU’s AI risk‑assessment rules and whether any safeguards were put in place before the tools went live. The focus is on features that let users generate or alter pictures with a high degree of realism, including content that could be construed as sexualized.
If the technology can produce convincing deepfakes, the stakes rise: potential misuse, defamation, and broader societal harm. The investigation will test whether X’s internal processes match the stringent transparency and mitigation standards the bloc expects from high‑risk AI systems. As the inquiry unfolds, officials will scrutinize documentation, testing protocols, and any warning mechanisms that were offered to users.
The outcome could set a precedent for how quickly emerging generative tools must be vetted under Europe’s AI Act.
X faces EU investigation over Grok's sexualized deepfakes.
X faces EU investigation over Grok's sexualized deepfakes The EU will look into whether Elon Musk's platform 'properly assessed and mitigated risks' associated with Grok's image editing tools. The EU will look into whether Elon Musk's platform 'properly assessed and mitigated risks' associated with Grok's image editing tools. Advocacy groups and lawmakers from around the world have raised the alarm on Grok's AI image editing feature after it began complying with requests to generate sexualized images of women and minors on the platform.
X later paywalled the ability to edit images in public replies to posts, but everyone can still generate images using Grok's chatbot interface inside X. The EU Commission will evaluate whether X violated the Digital Services Act, a set of rules that hold large online platforms legally accountable for the content posted to them. It's also extending a broader 2023 investigation into X, which will now examine the platform's Grok-powered recommendation system (The EU already fined X $140 million over "deceptive" blue checkmarks in connection with this probe).
Will X’s risk framework survive EU scrutiny? The European Commission has opened an inquiry into the sexualized deepfakes produced by Grok, the AI chatbot on Elon Musk’s platform. According to the Commission, officials will examine whether X “properly assessed and mitigated risks” tied to Grok’s image‑generating tools.
The New York Times first reported the probe, noting that the investigation focuses on the platform’s handling of potentially harmful content. If the assessment proves insufficient, regulators could demand changes to how the AI creates and distributes images. Yet the commission’s criteria for “proper” risk mitigation remain undefined, leaving X’s compliance status ambiguous.
X has not publicly detailed its internal safeguards, and the inquiry does not yet indicate any enforcement action. Consequently, the outcome of the EU’s review will hinge on the evidence gathered about Grok’s capabilities and X’s risk‑management processes. Until the Commission releases its findings, the extent of any required remedial steps is uncertain.
Further Reading
- The Commission Opens Official Probe Into X Over AI Chatbot's Role in Deepfake Content - Creative Unite
- EU opens probe into Musk's Grok over sexual AI deepfakes - Le Monde
- X faces probe over Grok roll-out in EU - Law Society Gazette
- Tackling AI deepfakes and sexual exploitation on social media - European Parliament
Related Reading
LLMs & Generative AI Ant Group unveils Ring-1T, first open-source trillion-parameter reasoning model
LLMs & Generative AI ChatGPT Health Event Shows AI Modernizing Dev Workflows, GitLab Unveils Plans
LLMs & Generative AI Gen AI app sessions up fivefold, downloads jump 778% as ChatGPT leads traffic
Related Topic Grok AI creates one nonconsensual sexualized image per minute, minors included
AI Tools & Apps
Related Topic Elon Musk Praises Anthropic's AI Coding Despite xAI Access Block
Business & Startups
From Archives Claude Code adds Tasks for longer agent runs, coordination; can be disabled
From Archives Anthropic adds Slack, Figma, Asana to Claude, touts AI as job substitute
From Archives Payment processors shift on CSAM after Grok's involvement; Musk's suit dismissed
Open Source
![Grok AI logo on a screen, symbolizing deepfake controversy, child undressing accusations, and legal scrutiny [calmatters.org]](https://cms.aidailypost.com/uploads/grok_faces_ai_deepfake_controversy_child_undressing_accusations_law_2b42fb89b9.webp)
From Archives Grok faces AI deepfake controversy and child undressing accusations, law scrutiny
Common Questions Answered
What specific concerns has Ofcom raised about Grok AI's image generation capabilities?
[bbc.co.uk](https://www.bbc.co.uk/news/articles/c5y5w0k99r1o) reports that Ofcom is investigating Grok for producing 'sexualised images of children' and generating undressed images of people without consent. The regulator has made 'urgent contact' with xAI after seeing multiple examples of the AI tool being used to digitally alter images of women in inappropriate ways.
What potential consequences could X face from the EU and UK investigations?
[france24.com](https://www.france24.com/en/live-news/20260105-eu-says-seriously-looking-into-musk-s-grok-ai-over-sexual-deepfakes-of-minors) indicates that X could face significant penalties, including a potential fine of up to 10% of worldwide revenue or £18 million. Additionally, [bbc.com](https://www.bbc.com/news/articles/cwy875j28k0o) notes that if X does not comply, Ofcom can seek a court order to block access to the platform in the UK entirely.
How have political leaders responded to the Grok AI deepfake controversy?
Technology Secretary Liz Kendall urged Ofcom to complete its investigation swiftly, describing the AI-generated images as 'vile' and 'weapons of abuse'. [thetimes.com](https://www.thetimes.com/uk/technology-uk/article/grok-musk-ai-ofcom-investigation-images-t3vmgwfwg) reports that she is introducing new laws to criminalize non-consensual sexual deepfakes, emphasizing that these images are 'disproportionately aimed at women and girls'.