Deepfake Nudes Targeting Underage Female Students at Collège Béliveau in Winnipeg Shared Online

In December 2023, female students at Collège Béliveau in Winnipeg were targeted by the creation and online distribution of non-consensual AI-generated nude images. The perpetrators reportedly used publicly accessible social media photos to generate the explicit content. The incident caused significant emotional distress among the student body and prompted an investigation by the Winnipeg Police Service, though no criminal charges were ultimately filed due to legal complexities surrounding AI-generated content.

At Collège Béliveau in Winnipeg, female students between grades 7-12 were targeted in the creation of deepfake nudes, which were then distributed online. Specific numbers and identities of victims and perpetrators were not released, and no charges were ultimately filed owing to the gap between existing laws and the nature of the incident.

Source: AI Incident Database

Risk classification

  • Primary risk domain: 4 Malicious actors
  • Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The incident involves the targeted creation of humiliating and sexualized deepfake imagery of specific underage victims for personal amusement or malicious intent.

Additional risk subdomains

  • 1.2 Exposure to toxic content: The AI was used to generate and distribute child sexual abuse material (CSAM), exposing the school community to highly toxic and illegal content.

Causal factors

  • Entity: Human
  • Intent: Intentional
  • Timing: Post-deployment

The harm was caused by human actors intentionally using deployed AI deepfake tools to alter and distribute images of students.

EU AI Act risk tier

  • Risk tier: 3 Limited Risk

Limited Risk: The report describes the use of AI-generated content such as deepfakes, which falls under Limited Risk and carries specific transparency obligations.

AI system and alleged parties

  • AI system: unspecified
  • AI purpose: Deepfake Image Generation; Image Generation
  • Behaviour type: Tool
  • Alleged developer: Unknown deepfake technology developers
  • Alleged deployer: Unknown deepfake creators
  • Alleged harmed parties: Collège Béliveau students

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Substantial. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

  • Physical: direct Negligible, indirect Negligible
  • Infrastructure: direct Negligible, indirect Negligible
  • Property: direct Negligible, indirect Negligible
  • Financial: direct Negligible, indirect Negligible
  • Environmental: direct Negligible, indirect Negligible
  • Malicious content: direct Minor, indirect Negligible
  • Differential treatment: direct Minor, indirect Negligible
  • Civil rights: direct Minor, indirect Negligible
  • Democracy: direct Negligible, indirect Negligible
  • Privacy: direct Negligible, indirect Negligible
  • Psychological: direct Minor, indirect Minor
  • Epistemic: direct Minor, indirect Negligible
  • Child sexual exploitation and abuse: direct Substantial, indirect Negligible

Malicious content

Reported: Yes, the reports describe the creation and circulation of explicit, AI-generated nude photos of underage girls.

Directly caused: Upwards of 300 explicit, AI-generated nude photos of underage female students were created and shared online.

Inferred additional harm: Additional explicit images may have been generated or shared privately without the school's or victims' knowledge.

Differential treatment

Reported: Yes, the reports note that female students were specifically targeted, and parents noted it is scarier for girls than guys.

Directly caused: Female students at the school were disproportionately targeted for sexualized deepfakes, resulting in gender-based harassment.

Civil rights

Reported: Yes, the non-consensual creation of sexualized deepfakes violates the victims' personal dignity and bodily autonomy.

Directly caused: The rights of dozens of underage girls to dignity and freedom from sexual exploitation were violated by the creation of synthetic CSAM.

Psychological

Reported: Yes, the reports describe students crying in hallways, feeling violated, and experiencing significant emotional distress.

Directly caused: Dozens of female students whose faces were used in the deepfakes experienced severe emotional distress, feelings of violation, and panic.

Indirectly caused: The broader student body experienced distress, anger, and tension, requiring the dispatch of social workers and clinical services.

Inferred additional harm: It is highly likely that the victims will suffer long-term psychological trauma, anxiety, and social difficulties due to the permanent nature of online images.

Epistemic

Reported: Yes, the reports describe the creation of highly convincing fake nude images that look real.

Directly caused: The AI tools were used to fabricate realistic nude images of students, creating false evidence of nudity.

Child sexual exploitation and abuse

Reported: Yes, the reports explicitly state that the generated images are technically child sexual abuse material (CSAM) or child pornography under the law.

Directly caused: The incident involved the creation of upwards of 300 AI-generated explicit images of underage girls, which constitutes child sexual abuse material.

People affected

  • Occurrences reported: 1
  • People reportedly harmed: 30
  • People reportedly exposed: 30

Potential causes

Management

  • Profit-Driven AI Development: Tech firms rush out AI for profit without ethics or safety guardrails.
  • Lack of Proactive Risk Assessment: Failure to assess risks of image generators before releasing them.

Technology

  • Highly Accessible Deepfake Tools: AI tools are increasingly advanced, free, and easy for anyone to use.
  • Realistic Image Manipulation: AI allows seamless face-swapping and clothing removal with high realism.

Data Inputs

  • Public Social Media Photos: Original student photos were gathered from publicly accessible social media.

Human Factors

  • Ignorance of Legal Consequences: Perpetrators do not understand that deepfakes are child abuse material.
  • Lack of Digital Literacy: Students are ill-equipped to handle online risks or know their rights.

Process and Methods

  • Outdated School Curriculum: Curriculum fails to address online sexual violence and legal consequences.
  • Difficult Image Removal Process: Removing images permanently from the internet is nearly impossible.

Regulatory Environment

  • Legal Gaps for AI Deepfakes: Many intimate image laws were created before deepfakes and lack key terms.
  • Extraterritorial Jurisdiction: Enforcing Canadian court orders on foreign websites is highly challenging.
  • Section 230 Liability Shield: US sites can ignore Canadian removal orders due to Section 230 protections.

Information quality

  • Classification confidence: High
  • Reason for confidence: The reports provide consistent, detailed accounts of the incident at Collège Béliveau, including the scale of the images (upwards of 300), the demographic targeted (dozens of female students), and the legal/educational responses. While the specific AI software is not named, the nature of the technology and its application are clearly described.
  • Ambiguities identified: The exact identity of the perpetrators (whether they were fellow students or external actors) and the specific AI apps used remain unconfirmed.
  • Alternative interpretations: None. The incident is clearly a case of non-consensual deepfake creation targeting minors.

An incident involving the creation and distribution of AI-generated non-consensual explicit images of teenage students in Winnipeg, Canada. While causing significant localized psychological harm and highlighting legal gaps regarding synthetic CSAM, the event has negligible direct implications for national security.

  • Overall national security impact: Minor
  • Scope: Single nation
  • Primary target: Canada
  • Alleged perpetrator: Unknown

Threat characteristics

  • Imminence: Long-term. Represents an ongoing societal risk associated with consumer-grade deepfake technology rather than an active national security crisis.
  • Autonomy: Human-controlled. The AI tool was directly operated by human users to perform specific image modifications with no autonomous agency.
  • Novelty: Established threat. The use of deepfake technology to generate non-consensual explicit imagery is a known and documented threat vector.

Impact by dimension

  • Physical security: Negligible. No physical systems, kinetic threats, or critical infrastructure were targeted or affected in this incident.
  • Information security: Negligible. No state-sponsored disinformation campaigns, intelligence compromise, or national-level information operations were detected.
  • Sovereignty: Negligible. The incident did not impact state authority, electoral systems, or core government decision-making processes.
  • Economic security: Negligible. No critical financial systems, strategic technologies, or national economic supply chains were compromised.
  • Societal stability: Minor. While representing a severe violation of individual privacy and dignity through the creation of synthetic CSAM, the societal impact remains localized and does not threaten national stability.
Explore in the interactive Incident Tracker