Australia's watchdog warns children at risk from AI deepfakes

Summarised from 2 outlets · Updated 19 Oct, 18:02 · Archive

Australia's online safety watchdog is calling for better protections for young people from harmful AI content, warning that regulators cannot keep pace with the technology.

Australia's eSafety commissioner Julie Inman-Grant is warning that artificial intelligence poses significant risks to children and vulnerable internet users, with regulators struggling to keep pace with the technology's rapid development. She will present evidence to a federal parliamentary inquiry into AI beginning in Sydney on Tuesday.

The watchdog has assisted in rolling out a school-based reporting system to address increasing incidents of teenage boys creating and sharing sexualised AI deepfake images and videos of girls based on publicly available photos. Enforcement action against several AI nudify services has resulted in eight of the most widely used programs withdrawing access from Australia or introducing age restrictions and stricter standards.

However, the commission acknowledges limitations in its authority. Non-sexual deepfakes such as face swaps, fake dance videos or harmful memes may cause significant distress but cannot be removed unless they meet specific thresholds under the commission's complaint schemes. The watchdog also warns that terrorists and violent extremists are developing ways to use generative AI to spread radicalisation material, and that AI tools could facilitate coercive control in abusive relationships through financial abuse and impersonation.

How it is being reported

• Watchdog warns kids at risk from surging AI deepfakesThe national online watchdog is calling for better protections for young Australians and other vulnerable internet users from harmful AI content.The West Australian · 19 Oct, 17:32
• Watchdog warns kids at risk from surging AI deepfakesThe national online watchdog is calling for better protections for young Australians and other vulnerable internet users from harmful AI content.Perth Now · 19 Oct, 17:32

In this story: Julie Inman-Grant · eSafety commissioner · Australia · Sydney

This summary was written by AI from the headlines and standfirsts above, and states as fact only what at least two outlets report. How we use AI · Report a problem