Kate Isaacs, Advocate Against Image-Based Abuse, Reports Being Deepfaked

Activist and anti-image-based abuse advocate [PERSON_001] was targeted by a deepfake attack where her likeness was superimposed onto pornographic content. This incident, which followed her advocacy work against unverified content on PornHub, resulted in significant online abuse, doxing, and threats of violence against her.

Kate Isaacs, a London-based activist and founder of the #NotYourPorn campaign, was targeted in a deepfake incident. Her face was alleged to have been digitally manipulated onto a pornographic video using AI and shared online. The reported video, tagged with her name, is alleged to have led to streams of abuse, doxing, and threats of violence. The attack reportedly followed her efforts to pressure PornHub to remove unverified content.

Source: AI Incident Database

Risk classification

  • Primary risk domain: 4 Malicious actors
  • Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The incident involves the targeted creation of humiliating and sexual deepfake imagery of a specific victim to silence and harass her, which fits the boundary rule for targeted humiliation under 4.3.

Additional risk subdomains

  • 1.2 Exposure to toxic content: The victim and social media users were exposed to non-consensual sexually explicit and abusive content generated by AI.

Causal factors

  • Entity: Human
  • Intent: Intentional
  • Timing: Post-deployment

The harm was caused by human actors intentionally using deployed AI deepfake tools to target, humiliate, and harass the victims.

EU AI Act risk tier

  • Risk tier: 3 Limited Risk

Limited Risk: The report describes AI-generated content such as deepfakes, which fall under Risk Level 3 and are subject to specific transparency obligations under the EU AI Act.

AI system and alleged parties

  • AI system: unspecified
  • AI purpose: Deepfake Video Generation; Deepfake Image Generation
  • Behaviour type: Tool
  • Alleged developer: Unknown deepfake technology developers
  • Alleged deployer: Unknown Twitter user
  • Alleged harmed parties: Kate Isaacs

Harm severity

Highest direct severity in any category: Severe. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

  • Physical: direct Negligible, indirect Negligible
  • Infrastructure: direct Negligible, indirect Negligible
  • Property: direct Negligible, indirect Negligible
  • Financial: direct Negligible, indirect Negligible
  • Environmental: direct Negligible, indirect Negligible
  • Malicious content: direct Substantial, indirect Substantial
  • Differential treatment: direct Minor, indirect Minor
  • Civil rights: direct Minor, indirect Minor
  • Democracy: direct Negligible, indirect Minor
  • Privacy: direct Negligible, indirect Minor
  • Psychological: direct Minor, indirect Minor
  • Epistemic: direct Minor, indirect Minor
  • Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Malicious content

Reported: The report explicitly describes the creation and distribution of toxic and malicious content, specifically non-consensual deepfake pornography.

Directly caused: AI deepfake software was used to generate sexually explicit videos and images of the victims without their consent, which were shared on public platforms like Twitter/X.

Indirectly caused: The posting of the deepfakes led to streams of abusive comments, rape threats, and doxing on social media.

Inferred additional harm: Millions of other deepfake pornographic videos are hosted on specialized websites, exposing millions of users to non-consensual toxic content.

Differential treatment

Reported: The report explicitly describes differential treatment, highlighting that this is a highly gendered crime primarily targeting women.

Directly caused: Women's public images were disproportionately harvested and weaponized to create sexually explicit content, subjecting them to systemic harassment and humiliation compared to men.

Indirectly caused: The societal shaming and harassment of female victims, such as the politician being propositioned on the street based on the fake video.

Inferred additional harm: Widespread systemic discrimination and harassment of women online through the proliferation of easy-to-use deepfake apps.

Civil rights

Reported: The report explicitly describes violations of human and civil rights, including bodily autonomy, dignity, and freedom from harassment.

Directly caused: The non-consensual use of the victims' identities and likenesses in sexual content violated their fundamental right to personal dignity and privacy.

Indirectly caused: The threats and harassment aimed to silence the campaigner [PERSON_001] and the politician, infringing on their freedom of expression and political participation.

Inferred additional harm: Thousands of women having their civil rights and personal safety compromised by non-consensual synthetic pornography.

Democracy

Reported: The report explicitly describes an attack on a political candidate during an active election campaign.

Directly caused: N/A

Indirectly caused: A Northern Irish politician was targeted with fake porn during her election campaign in April 2022 to discredit and silence her, undermining democratic participation.

Inferred additional harm: The proliferation of deepfakes targeting female politicians could discourage women from running for public office, eroding democratic representation.

Privacy

Reported: The report describes privacy violations, but these were carried out by human actors rather than the AI system itself.

Directly caused: N/A

Indirectly caused: Human perpetrators doxed [PERSON_001] by posting her work and home addresses online alongside the deepfake video.

Inferred additional harm: N/A

Psychological

Reported: The report explicitly describes severe psychological and mental-health harm to multiple victims, including panic, terror, anxiety, paranoia, and trauma.

Directly caused: [PERSON_001] experienced severe panic, terror, and paranoia, causing her to restrict her movements and delete her Twitter account. Other victims reported feeling devastated, violated, and living in a constant state of fear.

Indirectly caused: The subsequent doxing, rape threats, and street harassment resulting from the deepfakes caused additional severe trauma and fear for personal safety.

Inferred additional harm: It is highly likely that thousands of other unquantified victims of these deepfake platforms suffer similar severe psychological trauma, anxiety, and depression.

Epistemic

Reported: The report explicitly describes epistemic harm, where highly convincing fake videos led people to believe the victims actually performed in pornographic videos.

Directly caused: AI software generated highly convincing visual hoaxes of the victims.

Indirectly caused: Members of the public believed the fake videos were real, leading to street harassment and public jeering of the politician.

Inferred additional harm: Widespread erosion of trust in digital media and video evidence due to the ubiquity of convincing deepfakes.

People affected

  • Occurrences reported: 5
  • People reportedly harmed: 5
  • People reportedly exposed: 50

Potential causes

Management

  • Inadequate Safety Resources: Tech companies fail to invest in proactive detection of sexual abuse content.

Technology

  • Advanced AI Face-Swapping Tech: Algorithms reconstruct highly convincing faces from minimal source footage.
  • Accessible Deepfake Applications: Apps like FaceMagic allow anyone to make deepfakes with a single click.

Data Inputs

  • Unprotected Social Media Photos: Innocent online photos and videos are harvested as source material.

Human Factors

  • Perpetrator Moral Disconnection: Creators dismiss psychological harm, viewing deepfakes as harmless fantasy.
  • Misogynistic Intimidation: Perpetrators weaponize deepfakes to silence and humiliate women campaigners.

Process and Methods

  • Reactive Content Moderation: Platforms rely on reports to remove content after the harm has occurred.
  • Flawed App Store Safeguards: Apps are distributed to minors without robust filters for sexual content.

Regulatory Environment

  • Outdated Cyber Laws: Existing laws fail to criminalize non-consensual deepfake creation directly.
  • Delayed Online Safety Bill: Legislative delays leave victims without protection as technology evolves.
  • Limited Police Cyber Powers: Police forces lack the technical resources and powers to trace perpetrators.

Information quality

  • Classification confidence: High
  • Reason for confidence: The reports provide detailed, consistent first-hand accounts from multiple victims regarding the creation, distribution, and impact of the deepfakes. The role of AI deepfake technology is clearly identified, and the resulting harms are well-documented across multiple reputable news sources.
  • Ambiguities identified: The specific AI models or apps used to create the deepfakes of [PERSON_001] and the politician are not identified, though general apps like FaceMagic are mentioned.
  • Alternative interpretations: None. The events clearly represent targeted harassment using synthetic media.

This incident involves the targeted creation of non-consensual deepfake pornography against an activist and a political candidate using consumer-grade AI tools. While causing severe psychological harm, doxing, and localized democratic disruption to a political campaign, the national security threat remains minor and manageable within standard law enforcement frameworks.

  • Overall national security impact: Minor
  • Response level: Moderate
  • Scope: Multiple nations
  • Primary target: United Kingdom
  • Other affected: Australia
  • Alleged perpetrator: Unknown

Threat characteristics

  • Imminence: Long-term. Represents an ongoing societal and technological challenge rather than an immediate national security crisis.
  • Autonomy: Human-controlled. Perpetrators manually operated consumer-grade AI software to generate the deepfake content.
  • Novelty: Evolved capability. Deepfake technology is established, but the ease of access to consumer-grade tools represents an evolved capability for targeted harassment.

Impact by dimension

  • Physical security: Negligible. No physical security threats, kinetic attacks, or critical infrastructure disruptions were reported in connection with this incident.
  • Information security: Minor. The incident involved the creation of non-consensual deepfakes targeting individuals, but there is no evidence of a coordinated, state-sponsored information warfare campaign.
  • Sovereignty: Minor. A Northern Irish politician's campaign was disrupted, representing an attack on a political candidate, but there was no systemic compromise of state authority or electoral systems.
  • Economic security: Negligible. The incident had no reported impact on financial systems, strategic industries, or technological competitive advantages.
  • Societal stability: Minor. The incident caused severe psychological harm, doxing, and harassment to targeted individuals, reflecting a broader gendered threat but without causing large-scale civil unrest.
Explore in the interactive Incident Tracker