Kristen Bell Deepfaked in Non-Consensual AI-Generated Pornography

This report details the non-consensual use of deepfake technology to create and distribute pornographic content featuring the likenesses of women, including celebrities and private individuals. The practice is described as a form of digital manipulation that strips victims of control over their own faces and contributes to sexual humiliation. Research cited in the report indicates that the vast majority of deepfakes found online are pornographic in nature and target women without their consent.

The actor Kristen Bell discovered that her likeness was exploited by creators of deepfake pornography, who shared their non-consensual sexual depictions of her on the Internet.

Source: AI Incident Database

Risk classification

  • Primary risk domain: 4 Malicious actors
  • Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The incident involves the targeted creation of humiliating and sexual deepfake imagery of specific victims (Kristen Bell and the Perth law graduate) without their consent, which fits under targeted manipulation and humiliation.

Additional risk subdomains

  • 1.2 Exposure to toxic content: The generated deepfake pornographic videos represent highly toxic, abusive, and sexually explicit content hosted on public platforms.

Causal factors

  • Entity: Human
  • Intent: Intentional
  • Timing: Post-deployment

The incident was caused by human actors intentionally utilizing deployed deepfake generation tools to create non-consensual pornographic content targeting specific women.

EU AI Act risk tier

  • Risk tier: 3 Limited Risk

Risk Level 3: Limited Risk. The incident involves 'AI-generated content such as deepfakes' which are subject to transparency obligations under the EU AI Act to ensure users are aware the content is synthetic.

AI system and alleged parties

  • AI system: deepfake technology
  • AI purpose: Deepfake Video Generation; Deepfake Image Generation
  • Behaviour type: Tool
  • Alleged developer: Unknown deepfake technology developers
  • Alleged deployer: Unknown deepfake creators
  • Alleged harmed parties: Kristen Bell

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

  • Physical: direct Negligible, indirect Negligible
  • Infrastructure: direct Negligible, indirect Negligible
  • Property: direct Negligible, indirect Negligible
  • Financial: direct Negligible, indirect Negligible
  • Environmental: direct Negligible, indirect Negligible
  • Malicious content: direct Minor, indirect Negligible
  • Differential treatment: direct Minor, indirect Negligible
  • Civil rights: direct Minor, indirect Negligible
  • Democracy: direct Negligible, indirect Negligible
  • Privacy: direct Minor, indirect Negligible
  • Psychological: direct Minor, indirect Negligible
  • Epistemic: direct Negligible, indirect Negligible
  • Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Malicious content

Reported: The report explicitly describes the creation and distribution of toxic and malicious content in the form of non-consensual deepfake pornography.

Directly caused: Pornographic deepfake videos of Kristen Bell and the Perth law graduate were created and uploaded online, with 96 percent of all online deepfakes reported to be pornographic.

Inferred additional harm: It is inferred that tens of thousands of non-consensual pornographic deepfake videos of women are hosted and spread across various online platforms and websites.

Differential treatment

Reported: The report explicitly describes differential treatment, noting that virtually all pornographic deepfakes target women.

Directly caused: The non-consensual deepfake technology disproportionately targets and exploits women, with 96 percent of deepfakes being pornographic and virtually all of those depicting women.

Inferred additional harm: This technology reinforces systemic gender-based harassment and the sexual objectification of women at scale across the internet.

Civil rights

Reported: The report explicitly discusses the violation of consent, which is a fundamental aspect of personal rights.

Directly caused: The victims' right to consent and control over their own likeness and bodily representation was violated by the non-consensual creation of sexual imagery.

Inferred additional harm: The widespread, non-consensual sexualization of women using AI represents a systemic threat to women's civil rights, personal safety, and digital autonomy.

Privacy

Reported: The report explicitly describes privacy violations where personal photos from social media were taken and manipulated without consent.

Directly caused: An unnamed Perth law graduate had her private social media photos taken and used without her consent to generate nude images and deepfake videos.

Inferred additional harm: Many individuals face ongoing violations of their personal privacy as their publicly shared photos are harvested to train models or generate non-consensual explicit content.

Psychological

Reported: The report explicitly describes psychological harm, noting that the victims felt shocked, exploited, and sexually humiliated.

Directly caused: Kristen Bell experienced shock and felt exploited upon discovering the deepfake videos, and the Perth law graduate suffered sexual humiliation from having her social media photos manipulated into nude images and videos.

Inferred additional harm: It is highly likely that thousands of other unnamed women targeted by non-consensual deepfake pornography experience severe emotional distress, anxiety, and trauma.

People affected

  • Occurrences reported: 2
  • People reportedly harmed: 2
  • People reportedly exposed: 2

Potential causes

Technology

  • Facial Expression Animation: Deepfake tech animates a victim's face using another's expressions.
  • Advanced Deepfake Algorithms: AI tools enable highly realistic face-swapping onto explicit videos.

Data Inputs

  • Accessible Social Media Photos: Publicly shared photos are harvested to train deepfake models.

Human Factors

  • Lack of Consent: Creators generate explicit content without target's permission.
  • Intent to Humiliate: Deepfakes are used as a tool for the sexual humiliation of women.

Process and Methods

  • Delayed Platform Bans: Platforms banned deepfakes only after widespread publication and harm.
  • Ineffective Content Filtering: Hosting sites struggled to detect and block non-consensual deepfakes.

Regulatory Environment

  • Lack of Legal Protections: Absence of strict laws governing unauthorized digital face manipulation.

Information quality

  • Classification confidence: High
  • Reason for confidence: The reports provide clear, first-hand accounts from one of the primary victims (Kristen Bell) and cite specific statistics from a Deeptrace study regarding the prevalence of pornographic deepfakes targeting women. The details regarding how the technology was used and its psychological impact are explicit and unambiguous.
  • Ambiguities identified: The specific AI software or platforms used to generate the deepfakes are not identified.
  • Alternative interpretations: None. The reports clearly describe non-consensual deepfake pornography.

The incident highlights the widespread use of deepfake technology for non-consensual pornography targeting women. While causing severe psychological harm and privacy violations to individuals, its direct national security impact is minor, primarily affecting digital privacy and human rights frameworks rather than critical infrastructure or state sovereignty.

  • Overall national security impact: Minor
  • Scope: Multiple nations
  • Primary target: No clear primary
  • Other affected: United States, Australia
  • Alleged perpetrator: Unknown

Threat characteristics

  • Imminence: Long-term. The proliferation of deepfake pornography is an ongoing, chronic societal and legal challenge rather than an immediate national security crisis.
  • Autonomy: Human-controlled. The AI systems function as tools requiring direct human initiation, input, and configuration to generate the deepfake content.
  • Novelty: Established threat. Non-consensual deepfake pornography has been a recognized and documented issue since at least 2017, with major platforms implementing bans starting in 2018.

Impact by dimension

  • Physical security: Negligible. The incident involves digital image manipulation and does not impact physical systems, critical infrastructure, or kinetic safety.
  • Information security: Negligible. While deepfakes can be used for information operations, this incident is limited to non-consensual pornography targeting individuals and does not involve state-sponsored intelligence or disinformation campaigns.
  • Sovereignty: Negligible. No impact on government decision-making, state authority, electoral systems, or constitutional processes.
  • Economic security: Negligible. No significant threat to financial systems, strategic technology theft, or critical supply chains indicated.
  • Societal stability: Minor. Represents a notable threat to individual privacy and digital autonomy, contributing to systemic gender-based harassment, though manageable within civil and legal frameworks rather than posing a threat to national stability.
Explore in the interactive Incident Tracker