Apple is facing new legal pressure over AI-powered apps that can generate fake intimate images. San Francisco City Attorney David Chiu has sent a cease-and-desist letter urging Apple to remove eight so-called “nudify” apps from the App Store. He also called on the company to end business relationships with the developers behind them. Google received a similar request.
The move follows growing concern about AI tools that create deepfake images without a person’s consent. Officials argue that these apps pose serious privacy and safety risks.
Deepfake Concerns Continue to Grow
“Nudify” apps use artificial intelligence to create fake intimate images by digitally altering photos. Some can generate explicit content involving unsuspecting individuals, including minors. These images often appear realistic, making them especially harmful when shared online.
Chiu described the technology as illegal, harmful, and unacceptable. He also argued that platform operators have a responsibility to prevent such apps from reaching consumers. His legal letters state that California law prohibits supporting services designed to create deepfake content.
Apple Responds to the Allegations
Apple rejected claims that it knowingly allows these apps on its platform. The company said its App Store rules have long prohibited applications that generate, distribute, or promote pornography, including nudification tools.
According to Apple, it has already removed three of the identified apps and has started terminating the developers’ accounts. In addition, the company said it is working with four other developers to address policy violations. Those apps also risk removal if they fail to comply. Apple added that it has previously rejected many similar apps during the review process and continues to block related search terms within the App Store.
Calls for Stronger Safeguards
Despite Apple’s response, Chiu plans to continue pursuing action against both Apple and Google. He wants stronger screening systems that can identify harmful AI apps before they become available for download.
The dispute highlights the growing challenge technology companies face as AI tools become more powerful. As regulators demand tougher oversight, app marketplaces may need stricter review processes to balance innovation with user safety and privacy.
