Nudify apps, Minnesota’s ban and the core clash over dignity
A nudify app ban is a legal restriction on apps and websites that use AI or other software tools to digitally remove clothing or generate non-consensual sexualized imagery of real people, targeting products that turn ordinary photos into deepfake intimate images without the subject’s consent as a way to protect privacy, safety and personal dignity. Minnesota’s new app law does exactly that: starting this weekend, it bans apps and sites that let users generate non-consensual sexualized imagery, including nudify-style outputs. Each time someone produces one of these images, the company behind the tool faces a USD 50,000 (approx. RM230,000) fine. That is not a symbolic gesture; it is a deliberate attempt to make non-consensual deepfakes financially intolerable. The measure reflects a hard truth policymakers have finally accepted: consent is not optional in the age of AI image generators.
xAI’s lawsuit: Free speech argument or defense of harmful tools?
Elon Musk’s xAI, now called SpaceXAI, has sued Minnesota’s attorney general, arguing that the nudify app ban violates free speech. In its complaint, the company calls the law an overbroad, content-based ban on visual expression and a “clumsy attempt to prohibit nudification,” claiming it sweeps in a wide range of protected speech. It warns that a business whose users generate 100,000 such images would face USD 50 billion (approx. RM230 billion) in fines, which it says is excessive and chilling. This posture is hard to reconcile with xAI’s own record: its Grok chatbot made headlines for generating thousands of “undressing” deepfakes every hour, including images of minors, and it still faces a proposed class-action suit from victims. When a company that has already enabled non-consensual deepfakes frames regulation as censorship, it looks less like a principled defense of free speech and more like an attempt to keep dangerous features alive.
App store moderation under pressure: San Francisco’s push on nudify apps
Minnesota’s law lands in a landscape where local regulators are no longer willing to trust app stores to police themselves. Investigators recently found “dozens of apps” offering deepfake non-consensual intimate images for payment in major mobile stores. After a study was shared with Apple and Google, they removed some nudify apps, but not all. That half-hearted response prompted the city of San Francisco to formally demand that both companies purge all nudify apps from their stores. This is app store moderation under a spotlight: platforms can no longer claim neutrality while hosting tools designed to strip people of control over their own bodies. Instead of quietly listing anything that generates clicks, they are being told to treat non-consensual deepfakes the way they treat malware or explicit abuse. That is not a slippery slope toward censorship; it is a baseline requirement for a functioning digital public square.
Real-world impact: Ordinary users as targets, not customers
The debate over the Minnesota app law is not abstract for victims. Non-consensual deepfakes weaponize ordinary photos, often pulled from social media, turning casual snapshots into sexualized images that can spread faster than any legal remedy. Parents are already being told the safest option is not to post photos of their children online, or to keep their accounts locked to trusted contacts. That is a grim indictment of the current ecosystem: people change their daily behavior because platforms allow hostile tools to thrive. And while nudify apps dominate headlines, the same pattern shows up in other tech risks. Millions of sites running certain content management system versions are vulnerable to full takeover by hackers, and users are urged to update immediately. In both cases, individuals bear the burden of defense while the companies that design and host powerful tools argue for minimal constraint. That imbalance is precisely what laws like Minnesota’s try to correct.
What this legal fight signals for AI’s future harms
Minnesota’s attorney general has been blunt: “AI nudification robs the target of their dignity and could cause them immense harm on many levels.” By asking the court to declare the law unconstitutional and block enforcement, xAI is forcing a high-stakes test of whether tools that reliably produce non-consensual deepfakes can hide behind speech protections. Whatever judges decide, one outcome is already clear: regulators and cities will not wait for platforms to solve AI abuse on their own. San Francisco’s demand that app stores purge nudify apps is described as another step in preventing AI-powered abuses. Laws and local actions are converging on the same message: if an app’s business model depends on violating consent, it is a liability, not innovation. The future of AI will be shaped less by the companies building the models and more by whether societies insist that human dignity sets the limits.
