News

Grok Supercharges the Nonconsensual Pornography Epidemic

Tech Policy Press · Kaylee Williams · last updated

This time last year, I conducted a study analyzing the technical features and marketing strategies of more than two dozen “undressing apps”—generative AI-powered tools that advertise their ability to transform images of fully clothed women into pornography.

I discovered tools that enable users to strip, pose, and digitally force victims into sexually explicit scenes “within moments” of uploading a single photo of the desired subject’s face. The most sophisticated apps also encouraged users to modify their victims’ physical appearances by altering the size of her breasts or adding tattoos to her skin. I found that for a few extra dollars, users could access premium features like video generation, allowing them to create explicit clips “shot from” various angles.

None of the tools I studied were as powerful, versatile, or as easily accessible as Elon Musk’s Grok.

The controversial AI model that once described itself as “MechaHitler,” developed by xAI and integrated into X.com, is at the center of a new Ofcom investigation this week and various other regulatory inquiries around the world after journalists began to raise flags shortly after the new year that the model was on a “mass digital undressing spree.” X has since disabled Grok’s image-generation features for most free users, limiting them to paying subscribers. Two countries—Indonesia and Malaysia—have also restricted access to Grok.

Related stories

Related Knowledge Center: Social media

State of Play

Social media platforms are the source of news for millions of people — and they have a fraught and ever-shifting relationship with the enterprises that provide that news.

The TikTok ban | The Meta-FTC trial


More informationabout Social media

Related Knowledge Center: Artificial intelligence

State of Play

On top of a failing business model, newsrooms must navigate the powerful — and not fully reliable — new capabilities of artificial intelligence and the deployment of large language models.

State of the business model | Copyright and intellectual property


More informationabout Artificial intelligence

Related Knowledge Center: Digital privacy and data security

State of Play

If you’re online, you’re generating a constant stream of information about yourself — sometimes voluntarily, sometimes unwittingly — that is assembled and used to craft your online experience. And generate wealth for data brokers. Meanwhile, designers and managers of the digital infrastructure on which the world depends are engaged in a never-ending effort to thwart attempts, by both criminal enterprises and state actors, to exploit vulnerabilities in those systems.   

Signalgate | State surveillance


More informationabout Digital privacy and data security