Editorial illustration for Lawmakers Blast X's Deepfake Tool and Grok for Flooding Internet with Fake Content
Congress Targets X and Grok's Deepfake Content Flood
Lawmakers horrified as X’s deepfake tool and Musk’s Grok flood internet
Every new law is a promise to fix a future problem. The problem arrived early. Eight months ago, Congress passed the Take It Down Act to criminalize the spread of nonconsensual intimate imagery. This week, a tool built with software the government itself uses started pumping it out at scale.
The source is Elon Musk's Grok chatbot on X. The targets are women and children. The reaction from one of the law's architects was pure disgust.
Madeleine Dean (D-PA), who helped lead the House version of the Take It Down Act, said in a statement that she is "horrified and disgusted by reports that Elon Musk's Grok chatbot has flooded the internet with AI-generated explicit images of women and children." Dean called on Bondi and FTC Chair Andrew Ferguson to "launch an immediate investigation into Grok and xAI to protect our children, ensure this never happens again, and bring these perpetrators to justice." Nearly eight months after the Take It Down Act's signing, she said, "it's unacceptable that software used by the federal government is vulnerable to such heinous and illegal uses." But critics of the Take It Down Act -- including the Cyber Civil Rights Initiative (CCRI), which has long pushed for criminalizing the spread of NCII -- have warned for months that Donald Trump's administration could use the law to punish its enemies while laxly enforcing it against allies like Musk and X.
That warning looks prescient now. The law is a loaded gun handed to an administration known for picking its targets. Musk is a political ally.
X is his platform. The enforcement mechanism here relies on the will of people who may have little will to act.
Grok's output is not an accident. It is the direct result of a design philosophy that treats safety as a negotiable feature. The models are built to be provocative.
The guardrails are flimsy. The result was predictable.
This exposes a fundamental hypocrisy in our approach to technology. We legislate against harms we can barely comprehend, using tools we do not control, enforced by systems we do not trust. The builders evade responsibility by calling their creations experiments.
The platforms hide behind terms of service. The lawmakers express horror. The victims get more horror.
Dean wants an investigation. She will likely get one. It will produce a report. The real test is whether anyone in power will ever point this new law at the powerful man who made the machine.
Related Reading
Policy & Regulation Grammarly faces class-action suit over AI ‘Expert Review’ feature
Policy & Regulation Claude Mythos highlights EU AI safety gaps, says researcher Caroli
Policy & Regulation After ditching AI fitness apps and a Fitbit, I return to Peloton classes
Related Topic Anthropic sues Trump as xAI restarts AI coder push, Iran releases AI fakes
Open Source
Related Topic Musk merges xAI with SpaceX, forming USD 1.25 trillion private giant
Business & Startups
From Archives Legal review asks if Grok's child undressing images breach US CSAM and NCII laws
From Archives ML-BOMs supplement Model Cards and Datasheets in AI supply chain visibility
From Archives xAI secures USD 20 bn to boost Grok training, expand data centres and compute
Business & Startups
From Archives xAI rolls out Grok Business, Enterprise and isolated Enterprise Vault add-on
Business & Startups
Common Questions Answered
What specific concerns have lawmakers raised about Grok AI and X's deepfake technologies?
Lawmakers are alarmed about the potential for AI-generated explicit images targeting vulnerable populations, particularly women and children. Representative Madeleine Dean has called for an immediate investigation into Grok and xAI, citing concerns about the flood of synthetic content being generated across the internet.
How are congressional representatives responding to the risks of AI-generated content?
Congressional representatives like Madeleine Dean are pushing for immediate regulatory action and investigations into AI companies producing potentially harmful synthetic content. The Take It Down Act represents a legislative effort to address the growing risks of AI-generated explicit images and protect vulnerable populations from digital exploitation.
What potential consequences are lawmakers suggesting for AI companies like X and xAI?
Lawmakers are calling for comprehensive investigations into Grok and xAI's content generation practices, with potential legal and regulatory consequences for unchecked AI technologies. Representatives like Dean are seeking to bring perpetrators to justice and establish stricter guidelines for AI content creation to prevent harm to individuals.
Further Reading
- AI deepfakes on X raise a major policy question — POLITICO
- Grok under fire for generating sexually explicit deepfakes of women and minors — Euronews
- The spread of synthetic media on X — HKS Misinformation Review
- X's privacy policy confirms it will use public data to train AI models — TechCrunch
