A Hidden Market for AI Nudify Apps
AI nudify apps—tools that digitally strip clothes from images—continue to thrive on major app stores despite explicit policies against non-consensual sexual content. A recent investigation by the Tech Transparency Project found 47 such apps on Apple’s App Store and 55 on Google Play, together downloaded 705 million times. These apps sit in plain sight, often marketed as harmless photo editors or AI art tools while enabling non-consensual deepfakes in a few taps. Standard commission rates of 15–30% mean Apple and Google take a cut from subscriptions, in-app purchases, and advertising tied to this abusive functionality. This ecosystem, identified by 54 civil rights groups as a USD 122 million (approx. RM561 million) market, reveals how app store abuse can be deeply embedded in mainstream platforms even as companies publicly promote their commitments to AI safety enforcement and user protection.
When Moderation Systems Miss the Worst Offenders
Both Apple and Google highlight robust app store moderation systems, but AI nudify apps expose critical gaps in enforcement. Apple’s latest fraud prevention report touts blocking more than USD 2.2 billion (approx. RM10.1 billion) in potentially fraudulent transactions and rejecting over 2 million problematic app submissions in 2025 through a mix of machine learning and human review. Yet, sophisticated abuse tools still slip through, often using “bait-and-switch” tactics: they appear as innocuous calculators or puzzle games during review, then switch to nudify functions after approval. Automated filters struggle to classify context-dependent harms like non-consensual deepfakes, while human reviewers face volume and obfuscation. This enforcement asymmetry—tough on financial fraud, weaker on intimate privacy abuses—shows how current AI safety enforcement frameworks are better tuned for transactional risks than for complex, targeted harms facilitated by abuse-focused apps.
Search Algorithms and the Promotion of Abuse
The problem is not only that AI nudify apps exist on app stores, but that platform features actively steer users toward them. The Tech Transparency Project reports that typing phrases like “AI NS” into Apple’s App Store triggers autocomplete suggestions such as “image to video ai nsfw,” leading directly to nudify tools. Around 40% of search results for terms like “undress” surface apps capable of generating nude images, with some labeled appropriate for children as young as four years old. Paid advertisements further amplify visibility, turning abusive functionality into promoted content. This is a stark failure of app store moderation design: ranking and recommendation systems, optimized for engagement and revenue, systematically boost non-consensual deepfake tools. Rather than acting as a safety layer, these discovery mechanisms become vectors of app store abuse, normalizing invasive AI and undermining stated policies against sexual exploitation.
Profits, Legal Pressure, and Platform Accountability
Civil rights groups argue that Apple and Google are not passive bystanders but direct beneficiaries of the AI nudify economy. With a USD 122 million (approx. RM561 million) abuse ecosystem running through their billing and advertising systems, both platforms earn ongoing revenue from non-consensual deepfakes. Advocates such as UltraViolet Action’s Jenna Sherman say previous warnings from state attorneys general in August 2025 and January 2026 went largely unheeded, prompting a new push for legal consequences rather than voluntary reforms. Their latest letter, delivered to the National Association of Attorneys General’s spring conference, frames app store abuse as a consumer protection and civil rights issue. Ben Winters from the Consumer Federation of America underscores that platforms are unlikely to curb these tools “out of the goodness of their own heart,” reinforcing calls for statutory obligations and penalties tied to AI safety enforcement failures.
The Human Cost of Non-Consensual Deepfakes
Behind the download numbers and revenue figures is a profound human toll. Non-consensual deepfakes weaponize AI nudify apps to violate privacy, damage reputations, and facilitate harassment. For vulnerable communities, the stakes are even higher. Dr. Crystal Cavalier from the Missing Murdered Indigenous Women Coalition describes these tools as a “new frontier of digital violence,” exacerbating already disproportionate rates of physical and sexual harm. Once an image is manipulated and shared, it can circulate indefinitely, making redress nearly impossible and compounding trauma. Victims may face blackmail, stalking, or job loss based on fabricated images that appear real to casual viewers. In this context, app store moderation failures are not abstract policy glitches but direct contributors to real-world risk. Effective AI safety enforcement must therefore prioritize bodily autonomy, consent, and long-term digital safety, not just financial fraud metrics.