Purported AI-Generated Explicit Deepfakes of Sydney High School Students Reportedly Circulated Online

New South Wales police in Australia launched an investigation after parents reported that purported AI-generated sexually explicit images of female students from a Sydney high school had been created and circulated online. The reported manipulated images, produced without consent using deepfake tools, prompted school involvement and a criminal probe under new state laws banning such content.

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The incident involves the targeted creation and circulation of sexually explicit deepfakes to humiliate and degrade specific female high school students.

Additional risk subdomains

• 1.2 Exposure to toxic content: The incident involved the creation and online circulation of sexually explicit, non-consensual synthetic content of minors.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The harm was caused by human actors intentionally using deployed AI 'nudify' tools to generate and circulate explicit deepfakes of classmates.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The report describes 'AI-generated content such as deepfakes' created by 'nudify' apps, which fall under transparency and disclosure obligations for synthetic media under the EU AI Act.

AI system and alleged parties

• AI system: deepfake tools
• AI purpose: Deepfake Image Generation; Deepfake Video Generation
• Behaviour type: Tool
• Alleged developer: Unknown deepfake technology developers
• Alleged deployer: Unknown actor(s) creating deepfake nudes of Sydney high school students
• Alleged harmed parties: Unnamed Sydney high school students, Families of unnamed Sydney high school students

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Substantial. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Minor, indirect Minor
• Differential treatment: direct Minor, indirect Negligible
• Civil rights: direct Minor, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Minor, indirect Negligible
• Psychological: direct Minor, indirect Minor
• Epistemic: direct Minor, indirect Negligible
• Child sexual exploitation and abuse: direct Substantial, indirect Substantial

Malicious content

Reported: Yes, the report describes the circulation of digitally altered explicit images online.

Directly caused: Creation of sexually explicit deepfake images of female high school students using 'nudify' apps.

Indirectly caused: Circulation of these explicit images within online groups and school communities.

Inferred additional harm: It is likely that the explicit images were further shared across other online platforms, expanding the reach of the toxic content beyond the initial groups.

Differential treatment

Reported: Yes, the report highlights that 'women and girls... are overwhelmingly the targets' of this degrading technology.

Directly caused: Female students were selectively targeted for sexual degradation and harassment using AI tools.

Inferred additional harm: The incident reinforces gender-based harassment, creating an unequal and hostile educational environment for female students compared to their male peers.

Civil rights

Reported: Yes, the report mentions significant risks to the 'wellbeing and privacy of students' and the 'dehumanising' nature of the technology.

Directly caused: Violation of the victims' rights to personal dignity, bodily integrity, and privacy through non-consensual sexual depiction.

Inferred additional harm: A broader erosion of the right of young women to feel safe, respected, and equal within educational institutions.

Privacy

Reported: Yes, the Department of Education spokesperson stated that deepfakes present 'significant new risks to the wellbeing and privacy of students'.

Directly caused: Non-consensual use of students' personal likenesses and faces to generate intimate synthetic images.

Psychological

Reported: Yes, the report describes female students being 'terrified' and 'really scared' of being targeted, noting 'devastating impacts' on women and girls.

Directly caused: The targeted female students suffered severe distress, humiliation, and emotional harm from having explicit deepfakes of themselves circulated.

Indirectly caused: Other female students at the school experienced anxiety, fear, and a diminished sense of safety due to the threat of being targeted.

Inferred additional harm: It is highly likely that the targeted victims (estimated 5-10 students) suffered long-term psychological trauma, anxiety, and social withdrawal requiring counseling.

Epistemic

Reported: Yes, the report describes the creation of 'digitally altered explicit images' and 'hyper realistic deepfake' content.

Directly caused: Generation of false, highly realistic synthetic images depicting real students in sexually explicit scenarios.

Child sexual exploitation and abuse

Reported: Yes, the report describes sexually explicit deepfakes targeting female high school students (minors).

Directly caused: Creation of AI-generated sexually explicit images of female high school students.

Indirectly caused: Circulation of these explicit images of minors on online platforms.

Inferred additional harm: The permanent digital footprint of these explicit images of minors online poses an ongoing risk of further exploitation and abuse.

People affected

• Occurrences reported: 1
• People reportedly harmed: 5
• People reportedly exposed: 10

Potential causes

Management

• Insufficient Platform Moderation: AI developers failed to block generation of explicit content.
• Weak Risk Assessments by Tech Firms: Companies deployed powerful AI without assessing risks to minors.

Technology

• Availability of Nudify Apps: AI apps allow easy generation of non-consensual explicit images.
• Hyper-realistic Generative AI: Advanced generative tools make deepfake media highly convincing.

Data Inputs

• Harvesting of Social Media Images: Publicly available photos were harvested to feed deepfake models.

Human Factors

• Lack of Student Digital Literacy: Students lack understanding of ethical AI use and online safety.
• Malicious Intent by Students: Individuals deliberately used AI tools to harass and degrade peers.

Process and Methods

• Delayed Content Removal: Platforms lacked rapid mechanisms to take down deepfake content.
• Inadequate School Guidelines: Schools lacked clear procedures for managing AI image-based abuse.

Regulatory Environment

• Lagging Legal Frameworks: Laws only recently evolved to criminalize deepfake image creation.
• Lack of App Store Restrictions: Nudifying services remained easily downloadable by minors.

Information quality

• Classification confidence: High
• Reason for confidence: The reports provide clear, consistent, and detailed accounts of the police investigation, the emotional impact on students, and the regulatory response from the eSafety Commissioner. The facts of the deepfake creation and distribution are well-established.
• Ambiguities identified: The specific 'nudify' apps used are not named, and the exact number of victims at the school is not specified beyond 'a number of families'.
• Alternative interpretations: None. The incident is clearly a case of image-based abuse using generative AI.

An investigation into AI-generated explicit deepfakes of high school students in Australia highlights an evolving societal challenge regarding synthetic media abuse. While causing severe distress to victims and prompting legislative action, the incident remains a localized criminal and educational issue with minor direct national security implications.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: Australia
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. The threat of AI-enabled image abuse is an ongoing societal and regulatory challenge rather than an immediate national security crisis.
• Autonomy: Human-controlled. The AI tools are used as passive instruments, requiring direct human action to harvest images, process them, and distribute the output.
• Novelty: Evolved capability. While non-consensual image sharing is an established issue, the high accessibility and realism of generative 'nudify' apps represent an evolved threat capability.

Impact by dimension

• Physical security: Negligible. No physical infrastructure or kinetic systems were targeted or affected in this incident.
• Information security: Negligible. The incident involves localized image abuse rather than state-sponsored information warfare, intelligence compromise, or espionage.
• Sovereignty: Negligible. Core government operations, electoral systems, and state sovereignty remain unaffected. The response is being handled by local police and educational authorities.
• Economic security: Negligible. No impact on financial systems, strategic technologies, or critical supply chains was reported.
• Societal stability: Minor. The incident represents a minor national security concern, reflecting a growing systemic threat to the privacy, dignity, and safety of female students nationwide, though currently managed through standard law enforcement and educational channels.