A Conservative MP, George Freeman, was the subject of a non-consensual deepfake video that falsely depicted him announcing his defection from the Conservative Party to Reform UK. The video, which used his likeness and voice, was widely circulated on social media, causing reputational harm and raising concerns about the impact of AI-generated disinformation on democratic processes. The MP reported the incident to the police and has advocated for legislative action against political deepfakes.
A purported AI-generated deepfake video circulated online falsely depicting UK Conservative MP George Freeman announcing his defection to the Reform UK party. The fabricated clip, which mimicked Freeman’s likeness and voice without his knowledge or consent, included statements critical of the Conservatives and was widely shared on social media. Freeman denounced the video as disinformation, reported it to police, and warned that such synthetic media pose serious risks to democratic processes.
Risk classification
- Primary risk domain: 4 Malicious actors
- Primary risk subdomain: 4.1 Disinformation, surveillance, and influence at scale
The incident involves the creation and distribution of a political deepfake designed to mislead the public and manipulate political discourse, representing a clear case of AI-enabled disinformation.
Additional risk subdomains
- 4.3 Fraud, scams, and targeted manipulation: The deepfake impersonated a specific MP without his consent, targeting his reputation and career.
- 1.2 Exposure to toxic content: The report also highlights the targeting of female politicians with non-consensual deepfake pornography.
Causal factors
- Entity: Human
- Intent: Intentional
- Timing: Post-deployment
The incident was caused by a human actor intentionally creating and distributing a deepfake video post-deployment to mislead the public and damage the MP's reputation.
EU AI Act risk tier
- Risk tier: 3 Limited Risk
Risk Level 3: Limited Risk. The EU AI Act classifies AI-generated content such as deepfakes under limited risk, which imposes specific transparency obligations to ensure users are informed that the content is AI-generated.
AI system and alleged parties
- AI system: None named
- AI purpose: Deepfake Video Generation; Voice Generation
- Behaviour type: Tool
- Alleged developer: Unknown voice cloning technology developers, Unknown deepfake technology developers
- Alleged deployer: Unknown actor impersonating George Freeman
- Alleged harmed parties: Truth, George Freeman, Epistemic integrity, Democracy, Conservative Party (UK)
Harm severity
Severity ratings are based on this scale.
Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
- Physical: direct Negligible, indirect Negligible
- Infrastructure: direct Negligible, indirect Negligible
- Property: direct Negligible, indirect Negligible
- Financial: direct Negligible, indirect Negligible
- Environmental: direct Negligible, indirect Negligible
- Malicious content: direct Minor, indirect Negligible
- Differential treatment: direct Negligible, indirect Negligible
- Civil rights: direct Negligible, indirect Negligible
- Democracy: direct Minor, indirect Minor
- Privacy: direct Negligible, indirect Negligible
- Psychological: direct Minor, indirect Negligible
- Epistemic: direct Minor, indirect Minor
- Child sexual exploitation and abuse: direct Negligible, indirect Negligible
Malicious content
Reported: The report explicitly describes the creation and spread of a malicious deepfake video.
Directly caused: An AI-generated deepfake video of MP George Freeman falsely claiming he defected to Reform UK was created and widely circulated on Facebook and X.
Democracy
Reported: The report explicitly describes concerns about the erosion of democratic norms and the integrity of the democratic process.
Directly caused: The deepfake video falsely represented an elected representative, which the MP stated has the potential to seriously distort, disrupt, and corrupt democracy.
Indirectly caused: The proliferation of such political deepfakes feeds a general public distrust, where voters feel they cannot believe anything they see, potentially discouraging them from voting.
Psychological
Reported: The report explicitly describes psychological distress and feelings of violation experienced by the targeted MP.
Directly caused: The MP described feeling similar to when he was once mugged, experiencing distress and shock when bombarded with accusations of betrayal from friends and colleagues.
Epistemic
Reported: The report explicitly describes epistemic harm through the deliberate spread of AI-generated misinformation.
Directly caused: The deepfake fabricated a false scenario where a Conservative MP announced he was joining Reform UK, misleading viewers who saw the viral video.
Indirectly caused: The incident contributes to the broader pollution of the information ecosystem, making it harder for citizens to distinguish real political announcements from synthetic fabrications.
People affected
- Occurrences reported: 1
- People reportedly harmed: 1
- People reportedly exposed: 1
Potential causes
Management
- Inadequate Platform Guidelines: Platform policies did not classify the political deepfake as a guideline breach.
Technology
- Widespread AI Availability: Decreased barriers to entry allow anyone to easily generate realistic deepfakes.
- Realistic Voice and Image Synthesis: AI tools enable highly convincing replication of a person's voice and likeness.
Data Inputs
- Unauthorised Media Usage: Existing public video and audio of the MP were used to train the AI model.
Human Factors
- Anonymity of Creators: Anonymity lets creators post damaging content without immediate consequences.
- Voter Susceptibility to Misinformation: Voters may easily believe and share realistic-looking deepfakes on social media.
Process and Methods
- Inadequate Platform Moderation: Meta and other platforms failed to quickly flag and remove the deepfake video.
- Viral Social Media Distribution: Algorithms and sharing mechanisms allowed the video to spread rapidly online.
Regulatory Environment
- Lack of Specific Laws: No clear laws exist targeting the unauthorized use of identity in deepfakes.
- Lagging Legal Frameworks: The law has not kept pace with rapid developments in AI-enabled threats.
Information quality
- Classification confidence: High
- Reason for confidence: The reports provide consistent, detailed accounts of the specific deepfake incident targeting George Freeman, including quotes from the victim, the platforms involved, and the response of authorities. The role of AI in generating the synthetic video is clear and undisputed.
- Ambiguities identified: The identity and specific motivation of the creator (whether a political opponent or a prankster) remain unknown.
An AI-generated deepfake video and voice clone of UK MP George Freeman falsely announced his defection to Reform UK. The incident demonstrates the rising threat of highly realistic, low-barrier AI disinformation targeting democratic processes and political figures. While causing no physical or economic harm, it highlights substantial risks to information security and democratic sovereignty, prompting electoral authorities to establish specialized monitoring capabilities.
- Overall national security impact: Substantial
- Scope: Single nation
- Primary target: United Kingdom
- Alleged perpetrator: Unknown
Threat characteristics
- Imminence: Long-term. Represents an ongoing strategic concern regarding the integrity of upcoming elections and democratic processes rather than an active, immediate crisis.
- Autonomy: Human-controlled. The AI system was used as a software tool by an anonymous human creator to generate synthetic media, with no autonomous decision-making by the AI.
- Novelty: Evolved capability. While political deepfakes have occurred before, this represents an evolved capability due to the high realism, voice cloning, and low barrier of entry.
Impact by dimension
- Physical security: Negligible. No physical systems, critical infrastructure, or human safety concerns were impacted by this incident.
- Information security: Substantial. The incident involved a highly realistic AI-generated deepfake video and voice clone of a UK MP, representing a clear case of AI-enabled political disinformation targeting public trust.
- Sovereignty: Substantial. Directly targeted an elected MP with false defection claims, raising concerns about the integrity of democratic processes and prompting the Electoral Commission to establish a specialized monitoring unit.
- Economic security: Negligible. No threats to financial systems, strategic technologies, or economic stability were reported.
- Societal stability: Minor. Caused distress to the individual MP and contributed to broader epistemic harm and public distrust in the information ecosystem, though without causing mass civil unrest.