A Shadow Market of AI Abuse Apps Hidden in Plain Sight
Behind polished app store storefronts, a thriving ecosystem of AI abuse apps has taken root. An investigation by the Tech Transparency Project found 102 so‑called “nudify” apps across major platforms—47 on Apple’s App Store and 55 on Google Play—despite both companies publicly banning tools that generate non-consensual sexual content. These apps, designed to digitally strip clothes from images, have been downloaded 705 million times worldwide, turning non-consensual AI tools into mainstream products rather than fringe experiments. The revenue is enormous: together, the apps generate USD 122 million (approx. RM563.2 million), from which Apple and Google collect their standard 15–30% commission. Far from being accidental policy violations, this is a large, lucrative category that has quietly flourished under the noses of companies that repeatedly tout their commitment to responsible AI and user safety.
Profit, Promotion, and the Illusion of AI Ethics Enforcement
Platform accountability is complicated by the fact that Apple and Google do not just host these apps—they help people find them. The Tech Transparency Project reports that Apple’s search autocomplete steers users toward nudify tools: typing “AI NS” can trigger suggestions like “image to video ai nsfw,” which lead directly to abuse apps. Around 40% of search results for terms such as “undress” surface apps capable of rendering women nude, some astonishingly rated as suitable for children as young as four years old. With both companies taking automatic cuts from in-app purchases and subscriptions, their app stores effectively convert non-consensual AI tools into recurring revenue streams. This stands in stark contrast to glossy AI ethics statements and safety guidelines, revealing an enforcement regime that often looks more like a public relations strategy than a serious attempt to curb AI-enabled sexual abuse.
Civil Rights Groups Push for Legal Consequences, Not Just Promises
Frustration with voluntary platform reforms has boiled over into coordinated legal pressure. A coalition of 54 civil rights organizations has urged state attorneys general to take action against Apple and Google for enabling an AI abuse ecosystem that profits from non-consensual sexual imagery. UltraViolet Action campaign director Jenna Sherman argues that the companies are “actively directing users to the tune of millions of dollars” toward these apps and insists that “the time has passed to appeal to the conscience” of tech executives. Ben Winters of the Consumer Federation of America echoes this sentiment, warning that the platforms “won’t stop this abuse out of the goodness of their own heart.” The coalition’s letter, timed to coincide with new app store accountability laws and presented at the National Association of Attorneys General’s spring conference, signals a shift from public shaming to demands for concrete legal consequences and enforceable AI ethics enforcement.
Real-World Harm: How Non-Consensual AI Tools Endanger Vulnerable Communities
Beyond app store policies and revenue figures lies the human impact of non-consensual AI tools. These apps can generate hyper-realistic nude images from everyday photos, creating new avenues for harassment, extortion, and lifelong reputational damage. Dr. Crystal Cavalier of the Missing Murdered Indigenous Women Coalition warns that AI deepfake abuse is “a new frontier of digital violence,” particularly for communities already facing disproportionate levels of physical and sexual violence. When manipulated images circulate without consent, victims may face social stigma, threats, or escalated offline abuse. For them, this is not a theoretical AI ethics debate but an attack on human dignity and bodily sovereignty. As platforms continue to profit from AI abuse apps, calls grow louder to treat these harms not as unfortunate side effects of innovation, but as preventable consequences of lax enforcement and misaligned business incentives.