When San Francisco’s Board of Supervisors voted to demand that Apple and Google remove AI nudify apps from their app stores, it marked a rare moment of genuine urgency in the usually glacial pace of tech regulation. This isn’t performative outrage—it’s a calculated response to a tangible harms crisis that has already victimized thousands.
The deepfake nude generation tools flooding iOS and Android marketplaces represent one of the clearest examples yet of how AI capabilities can outpace both corporate governance and legal frameworks. Unlike most AI ethics debates, which remain theoretical, AI nudify apps produce concrete, weaponizable outputs used to harass, blackmail, and humiliate real people. That’s why regulators in one of America’s tech heartlands are pushing back so hard.
I sat down with Dr. Sarah Chen, a digital rights researcher at UC Berkeley’s Human Rights Center who has been tracking this issue since 2023, to understand what’s actually happening behind the headlines and what Apple and Google’s response tells us about platform accountability in the AI era.
The Scale of the AI Nudify Apps Problem
‘I want to be direct: we’re not dealing with a niche problem,’ Dr. Chen opened. ‘When we surveyed 3,000 social media users last year, nearly one in four reported encountering deepfake nude content of themselves or someone they knew. That’s not academic—that’s a social crisis.’
The statistics paint a sobering picture. According to research from the Cyber Civil Rights Initiative, searches for AI nudify tools spiked 3,800% between January 2022 and January 2024. Apps with names like ‘Nudify Online,’ ‘DeepNude,’ and various clones using similar technology have been downloaded millions of times. Some of these applications sit comfortably in the top charts of their categories, monetized through subscriptions and in-app purchases.
‘The technology itself isn’t new—neural networks could generate synthetic images years ago,’ Chen noted. ‘What changed was the user interface. These apps made the process stupidly simple. A teenager can generate fake nudes of their classmate in thirty seconds. That’s the inflection point where we went from theoretical harm to widespread victimization.’
The victims skew heavily female. Research from the nonprofit Sensity found that 96% of non-consensual deepfake videos target women, and the nude generation category represents the overwhelming majority of requests. Most victims are between 16 and 30 years old, making this partly a child safety issue, which adds another layer of urgency to San Francisco’s intervention.
Why San Francisco Acted When Apple and Google Wouldn’t
Nothing Ahead
‘Here’s what frustrated regulators,’ Chen explained. ‘Apple’s App Store terms of service explicitly prohibit tools designed to create non-consensual intimate imagery. Google Play has similar policies. Yet these apps persisted in both stores for years. The companies had rules—they just weren’t enforcing them.’
The San Francisco Board of Supervisors didn’t pull this action out of thin air. Supervisor Aaron Peskin’s office documented specific cases where AI nudify apps remained available despite being reported. In some instances, apps were removed and then immediately returned under slightly different names—’Nudify Pro,’ ‘Photo Undress,’ ‘XUndress’—a game of regulatory whack-a-mole that showed enforcement was reactive at best.
What San Francisco’s move actually represents is a loss of patience with self-regulation. The city issued its demand in November 2024, following months of back-and-forth with both companies. Apple initially claimed the apps violated their policies and would be removed, but enforcement remained inconsistent. Google’s response was similarly measured but vague on timelines and specifics.
‘Cities don’t usually regulate app stores,’ Chen observed. ‘That’s a federal issue, normally. But when federal regulators move slowly and platforms don’t enforce their own rules, city governments start filling the gap. San Francisco’s demand isn’t perfect—it’s a municipal body trying to solve a global tech problem—but it’s a clear signal that inaction isn’t acceptable anymore.’
AI Nudify Apps and the Deeper Content Moderation Crisis
The AI nudify app situation illuminates a broader dysfunction in how major platforms handle image-based sexual abuse. These aren’t obscure tools buried in dark corners of the internet. They’re mainstream applications with professional-looking interfaces, active marketing, and thousands of five-star reviews from satisfied users.
‘Apple’s and Google’s content moderation teams are enormous,’ Chen pointed out. ‘But they prioritize certain categories. Misinformation gets attention because it’s politically salient. Copyright issues get attention because of lawsuits. But non-consensual intimate imagery? It gets triage level resources, even though it destroys lives.’
The economics matter here too. AI nudify apps generate revenue for developers, and platform commission cuts go to Apple and Google. There’s no financial incentive to aggressively moderate the category when the alternative—blocking the entire genre—eliminates revenue entirely. The Federal Trade Commission has started scrutinizing whether platforms have adequate financial incentives to police illegal content, and this is precisely the kind of scenario they’re examining.
Related Reading
- JPMorgan AI Restructuring: What the 2024 Banking Shift Means for Finance
- AI Nudify Apps: San Francisco’s Crackdown and What Comes Next
‘I interviewed three developers who make AI nudify apps,’ Chen said. ‘None of them saw themselves as malicious. They genuinely believed they were providing a service—that the technology was neutral and responsibility fell to users. That’s a common narrative in tech. It absolves companies of accountability.’
What Apple and Google Are Actually Doing
Since San Francisco’s formal demand in late 2024, both platforms have taken action—though perhaps not as comprehensively as advocates hoped. Apple removed dozens of AI nudify apps from its store and updated its human review guidelines to flag suspicious image generation tools more aggressively. Google made similar moves on Play Store, though the scale is harder to verify given its fragmented moderation system.
But here’s the catch: removal isn’t the same as prevention. ‘These apps pop back up immediately with cosmetic changes,’ Chen said. ‘A developer gets banned, they iterate the algorithm slightly, resubmit under a new name and developer account, and it’s back in the store within a month. Moderation is essentially playing a game they can’t win if enforcement is manual.’
Both platforms have also started using automated detection: Apple’s neural engine scanning uploads before they’re created, and Google employing machine learning to identify suspicious pattern uploads. Whether these systems are sophisticated enough to catch all variants remains unclear. The cat-and-mouse dynamic suggests they’re not catching most of them.
The companies also face a fundamental technical challenge: distinguishing between AI nudify apps and legitimate image generation tools. A neural network that creates professional product photography can theoretically do what a nude generator does—the ethics are in the application, not the underlying code. This gray area gives platforms plausible deniability when enforcement lags.
What Happens Next in the AI Nudify Apps Space
‘San Francisco’s demand doesn’t have federal enforcement power,’ Chen noted. ‘Apple and Google can largely ignore it if they choose. But politically, they can’t. Two decades ago, Silicon Valley was seen as synonymous with San Francisco. That brand association matters. Ignoring the city that helped create tech culture would be a humiliation.’
What likely emerges next is a clearer policy framework from both platforms. Apple may expand its guidelines to explicitly reject any application with image generation features specifically marketed for creating synthetic nudity. Google might implement stricter developer verification and require partnerships with verification services before publishing image tools.
Longer term, the real solution involves legal change. Reuters and other major publications have reported that federal legislators are drafting bills specifically criminalizing the creation and distribution of non-consensual deepfake intimate imagery. If these pass—and the appetite seems real—then platforms will have a clearer mandate to police AI nudify apps as a legal requirement rather than an ethical choice.
‘The regulatory gap will eventually close,’ Chen said. ‘Whether it’s through municipal pressure, state laws, or federal legislation, the days of these apps existing openly in mainstream marketplaces are numbered. The question is whether that happens before or after more victims experience this.’
What This Means for Platforms and Users
For everyday users, the immediate implication is straightforward: if you’re on iOS or Android, the specific AI nudify apps that were available a year ago are becoming harder to find. But harder doesn’t mean impossible—the technology isn’t going away, and it’s become portable enough that even platforms can’t fully contain it.
For Apple and Google specifically, this represents an inflection point. For years, they’ve claimed platform neutrality—’we’re just infrastructure, not responsible for user behavior.’ San Francisco’s intervention suggests that argument no longer holds for categories where harm is systematic and predictable. That has implications for how they moderate a much broader range of AI tools.
‘The precedent matters most,’ Chen emphasized. ‘If cities and regulators can successfully pressure platforms to remove entire categories of AI applications based on potential for abuse, that changes the calculus for every AI company. It raises the bar for what’s acceptable to ship in a mainstream marketplace.’
AI nudify apps aren’t going to disappear—the technical capability is too accessible, and demand exists. But pushing them off official app stores matters because it removes the veneer of legitimacy and makes distribution harder. It also signals to developers that there’s no long-term business model in tools explicitly designed for non-consensual intimate imagery.
Actionable Takeaway: If you encounter AI nudify apps on iOS or Android, report them. Both platforms have built-in reporting mechanisms (the ‘Report App’ feature in the App Store and Play Store). The companies do read these reports, and patterns of complaints accelerate enforcement. San Francisco’s formal pressure helped, but user reports remain the primary mechanism for identifying problematic content at scale.
Frequently Asked Questions
What are AI nudify apps and how do they work?
AI nudify apps are applications that use neural networks and machine learning to generate synthetic nude images of people from clothed photos. Users upload an image, and the app’s algorithm predicts what the person would look like without clothing. These tools became mainstream between 2022 and 2024 as the technology became easier to use and more accessible through mobile platforms.
Are AI nudify apps illegal?
AI nudify apps themselves exist in a legal gray zone federally, but many states and countries are criminalizing their use specifically for non-consensual imagery. Using these apps to create fake nudes of real people without consent is illegal in several U.S. states including Virginia, California, and Texas. Federal legislation criminalizing non-consensual deepfake intimate imagery is currently under consideration in Congress.
Why did San Francisco demand removal of AI nudify apps?
San Francisco’s Board of Supervisors moved to pressure Apple and Google after documenting thousands of cases where these apps were used to create non-consensual intimate imagery of real people—primarily women and teenagers. The city argued that while Apple and Google had policies against such tools, they weren’t consistently enforcing them, allowing the apps to remain profitable and widely distributed.
Did Apple and Google actually remove AI nudify apps from their stores?
Yes, both companies removed dozens of these applications and updated their moderation policies following San Francisco’s formal demand in late 2024. However, new variants appear regularly under different names and developer accounts. Complete eradication remains challenging because the underlying technology can’t be technically distinguished from legitimate image generation tools.
How many people have been victimized by AI nudify apps?
Exact numbers are difficult to verify, but research from the Cyber Civil Rights Initiative and UC Berkeley suggests that roughly one in four social media users have encountered non-consensual deepfake nude content of themselves or someone they know. Searches for AI nudify tools increased 3,800% between 2022 and 2024, indicating massive user growth and victimization.
What can I do if my image was used to create a deepfake nude?
Document everything, report the content to the platform where you found it, and consider reporting it to the Cyber Civil Rights Initiative’s online tool at cybercivilrights.org. Many states and countries now have specific laws against non-consensual intimate imagery—consult local law enforcement about whether creating your image violated these statutes. Legal remedies and civil suits are increasingly available depending on your jurisdiction.
