Deepfake Video Circulating of British Labour Leader Keir Starmer Touting an Investment Scheme

A deepfake video was circulating around social media of British Labour leader Keir Starmer touting an investment scheme.

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The deepfake video was created to impersonate a trusted public figure for the purpose of promoting a fraudulent investment scam to obtain financial benefit.

Additional risk subdomains

• 3.1 False or misleading information: The video generated and spread false information about a non-existent government-backed investment scheme.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The incident was caused by human actors who intentionally created and distributed a deepfake video to defraud social media users using post-deployment AI tools.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Risk Level 3: Limited Risk. The incident involves AI-generated content such as deepfakes, which are subject to specific transparency obligations under the Act.

AI system and alleged parties

• AI system: None named
• AI purpose: Deepfake Video Generation; Voice Generation
• Behaviour type: Tool
• Alleged developer: unknown
• Alleged deployer: unknown
• Alleged harmed parties: Keir Starmer, General public, British Labour Party

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Minor, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Minor
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Minor, indirect Substantial
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Malicious content

Reported: The report explicitly describes malicious content created and spread directly by the incident.

Directly caused: A deepfake video impersonating a politician to promote a financial scam was created and shared on Facebook.

Democracy

Reported: The report explicitly describes the erosion of democratic norms through the spread of realistic deepfakes of political figures.

Indirectly caused: The proliferation of deepfakes of political figures like Sadiq Khan and Keir Starmer erodes trust in public officials and democratic institutions.

Inferred additional harm: Continued spread of such deepfakes could severely undermine public trust in official communications and democratic processes.

Epistemic

Reported: The report explicitly describes epistemic harm through the spread of realistic deepfake material and misinformation online.

Directly caused: A fabricated video of the Labour leader promoting a fake government initiative was circulated on Facebook, misleading viewers.

Indirectly caused: The emergence of realistic deepfakes increases the challenges of verification and erodes the shared consensus reality.

Inferred additional harm: Widespread exposure to such deepfakes makes it increasingly difficult for the public to distinguish real media from synthetic media.

People affected

• Occurrences reported: 1
• People reportedly harmed: 1
• People reportedly exposed: 1000

Potential causes

Technology

• Voice Cloning AI Technology: AI tools easily clone voices to convincingly imitate real public figures.
• Poor Lip-Syncing Generation: AI struggle to generate natural mouth and teeth looks, causing blurriness.

Data Inputs

• Use of Real Public Video Footage: Real footage from the 2023 address was used as input to overlay deepfake.
• Lack of Input Verification: No mechanism to verify authenticity of input media used for social sharing.

Human Factors

• Rapid Spread of Misinformation: Users sharing unverified realistic deepfakes quickly across social media.
• Difficulty in Detecting Deepfakes: Voice cloning is becoming increasingly hard for average users to detect.

Process and Methods

• Inadequate Platform Moderation: Social platforms struggle to respond quickly to verified deepfake content.
• Verification Challenges: New technology exposes increased challenges for rapid content verification.

Information quality

• Classification confidence: High
• Reason for confidence: The report clearly details the nature of the deepfake, the debunking process, and the expert analysis of the synthetic media. There is no ambiguity regarding the fact that the video is a deepfake scam.
• Ambiguities identified: The specific AI tools or platforms used to generate the cloned voice and video are not identified.
• Alternative interpretations: None.

A deepfake video impersonated UK Labour leader Keir Starmer to promote a fraudulent investment scam on Facebook. While illustrating the growing accessibility of voice cloning tools and their potential to erode trust in public figures, the incident is a financially motivated scam with minor national security implications.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: United Kingdom
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. The incident represents an ongoing strategic concern regarding synthetic media proliferation rather than an active national security crisis.
• Autonomy: Human-controlled. The AI tools for voice cloning and video manipulation were directly operated by human creators to generate the deceptive content.
• Novelty: Established threat. Deepfakes of public figures used for financial scams and misinformation are an established threat vector with many prior instances.

Impact by dimension

• Physical security: Negligible. No physical threat, kinetic attack, or critical infrastructure impact was reported in this incident.
• Information security: Minor. While a political leader was impersonated, the deepfake was a low-quality financial scam rather than a coordinated state-sponsored information warfare campaign.
• Sovereignty: Minor. Impersonates a political figure promoting a fake government scheme, but does not disrupt core government operations or constitutional processes.
• Economic security: Negligible. Represents a low-level consumer fraud risk with negligible impact on systemic economic stability or strategic industries.
• Societal stability: Minor. Contributes to the gradual erosion of public trust in official media, but is manageable within standard content moderation and law enforcement procedures.