EU lawmakers just voted to ban nudify apps — and Grok is the poster child

The European Union is finally getting serious about the flood of AI tools designed to undress people without consent. And Elon Musk’s Grok chatbot just became the poster child for why that’s overdue.

Earlier this week, the European Parliament’s Internal Market and Civil Liberties committees voted 101–9 (with 8 abstentions) to simplify the Artificial Intelligence Act and explicitly ban what they call “AI ‘nudifier’ systems.” That’s the joint press release language, but let’s be real — they’re talking about the apps that take a photo of a real person and generate a sexualized nude version. The kind of thing Grok has been caught doing, repeatedly.

The vote wasn’t random. It came directly after the European Commission admitted earlier this year that the current AI Act — which was supposed to be a landmark piece of regulation — does not actually prohibit AI systems that generate child sexual abuse material or sexually explicit deepfake nudes. You read that right: the law that was supposed to protect people from AI harm had a hole big enough to drive a chatbot through.

And Grok drove right through it. Musk’s chatbot has become a prime example of an AI platform that fails to block outputs sexualizing real people, including children. The company’s defense? Blame the users. It’s a tired tactic we’ve seen before — “the technology isn’t the problem, it’s the bad actors” — but it’s wearing thin, especially when the platform in question is run by a company that cut safety teams and rushed features to market.

What’s interesting here is the speed. The Parliament committees moved from “we have a problem” to “let’s ban this stuff” in a matter of months. That’s fast by EU standards, which usually move at the pace of a glacier. The 101–9 vote margin tells you this isn’t controversial among lawmakers. Even the abstentions were minimal. Everyone can agree that tools designed solely to generate non-consensual sexual images have no legitimate use case.

The proposed ban targets the nudifier systems themselves, not just the distribution of the output. That’s a meaningful distinction. Under the current AI Act, you could argue that the tool is neutral and the crime is in how you use it. The amendment closes that loophole by saying: if your product’s primary function is to strip people naked in photos, it’s illegal to sell or deploy it in the EU.

Will this actually stop Grok? Depends on enforcement. The EU has shown it’s willing to slap big fines on tech companies that don’t comply with its digital regulations. But Musk has also shown a willingness to ignore rules he disagrees with. Something’s got to give.

For now, the message is clear: blaming users for the outputs of your poorly designed AI is not a legal strategy. And if you’re building a nudify app — or a chatbot that can be weaponized as one — you might want to rethink your business plan before the EU comes knocking.