Apple tightens App Store rules against AI deepfake intimate imagery

Summarised from 2 outlets · Updated 17 Oct, 00:08 · Archive

Apple has expanded App Store rules to ban AI-generated nonconsensual intimate imagery and apps that generate such content.

Apple has updated its App Store rules to explicitly prohibit AI-generated nonconsensual intimate imagery. The changes target so-called 'nudify' apps that generate intimate images without consent, and require developers to proactively prevent and remove such content from their platforms. Apps that fail to implement adequate safeguards risk removal from the App Store.

The rule changes follow significant criticism of xAI's Grok chatbot after users employed it to create sexualized deepfakes earlier this year. Apple had previously threatened to remove Grok from the App Store over the issue, prompting xAI to add safeguards. In July, Apple also removed 13 'nudify' apps from the App Store following an order from a San Francisco city attorney.

Apple also clarified rules against 'bait-and-switch' apps — applications that add prohibited features after they have been approved for distribution. The rules now explicitly state that apps concealing nudification capabilities during review and adding them after approval are prohibited. Additionally, Apple extended its ban on apps facilitating human trafficking or child exploitation to alternative app distribution methods.

How it is being reported

• Apple’s updated App Store rules go after ‘nudify’ AI appsApple's App Store rules now more explicitly ban so-called "nudify" apps that generate intimate images of people without their consent using AI tools. The rule changes follow significant criticism toward Apple after X users used Grok earlier this year to make nonconsensual, sexualized deepfakes, including minors. Apple didn't pull X or Grok from the App […]The Verge · 16 Oct, 23:51
• New App Store Rules Target AI Deepfakes and Nudify AppsApple today expanded its App Store moderation rules to cover AI-generated nonconsensual intimate imagery. Sexually explicit content was already banned, but now Apple says app developers must proactively prevent and remove AI-generated deepfakes from their platforms. Apple warns that apps with offending content could be removed from the App Store if developers fail to act. The updated 1.2 rule names AI content creation apps and could be targeting apps like Grok, among others. Users have complained about xAI's Grok chatbot being used for nude and sexualized deepfakes, and earlier this year…MacRumors · 16 Oct, 23:21

In this story: Apple · xAI · Grok · App Store

This summary was written by AI from the headlines and standfirsts above, and states as fact only what at least two outlets report. How we use AI · Report a problem