Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta

143 deepfake ads, over 100 of which reportedly impersonated former British Prime Minister Rishi Sunak, were promoted on Meta's platform to advertise the fraudulent investment scheme "Quantum AI." Funding for the ads reportedly originated from 23 countries. Up to 462,000 users may have been exposed to the false content. The campaign used generative AI tools to create high-quality misinformation, including spoofed BBC news clips for added legitimacy

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The deepfake videos of Rishi Sunak and the BBC newsreader were created and promoted to deceive users into participating in a fraudulent investment scam for the perpetrators' financial gain.

Additional risk subdomains

• 4.1 Disinformation, surveillance, and influence at scale: The coordinated campaign used en masse deepfakes of a major political figure to reach up to 400,000 people, raising significant concerns about election manipulation and public opinion influence.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The incident was caused by malicious human actors who intentionally created and paid to promote deepfake advertisements to scam users.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The incident involves AI-generated content such as deepfakes, which under the EU AI Act are subject to specific transparency obligations to ensure users are informed that the content is AI-generated.

AI system and alleged parties

• AI system: generative AI tools
• AI purpose: Deepfake Video Generation; Voice Generation
• Behaviour type: Tool
• Alleged developer: Unknown deepfake technology developers
• Alleged deployer: Quantum AI scammers
• Alleged harmed parties: Rishi Sunak, Quantum AI victims, Meta users, BBC News presenters

Harm severity

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Minor, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Minor
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Minor, indirect Minor
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Malicious content

Reported: Yes, the report describes over 100 deepfake video advertisements impersonating Rishi Sunak and a BBC newsreader.

Directly caused: The creation and distribution of 143 deepfake video ads on Facebook, reaching up to 400,000 people.

Indirectly caused: N/A

Inferred additional harm: N/A

Democracy

Reported: Yes, the report highlights concerns raised by experts and the government about the risk of AI-generated falsehoods manipulating elections and democratic processes.

Directly caused: N/A

Indirectly caused: The systematic impersonation of the Prime Minister en masse undermines public trust in political figures and democratic institutions ahead of the general election.

Inferred additional harm: The widespread use of such deepfakes could lead to broader erosion of trust in democratic elections and political campaigns.

Epistemic

Reported: Yes, the report describes the generation of false news reports and fake statements by the Prime Minister.

Directly caused: The fabrication of a BBC news broadcast and faked statements by Rishi Sunak claiming the government tested a stock-collecting application.

Indirectly caused: The promotion of these falsehoods to up to 400,000 people on Facebook, eroding the shared consensus reality and trust in trusted news sources like the BBC.

Inferred additional harm: N/A

People affected

• Occurrences reported: 1
• People reportedly exposed: 400000

Potential causes

Management

• Prioritizing Ad Revenue: Platform prioritizing ad monetization over robust safety enforcement.
• Inadequate Safety Investment: Insufficient resources allocated to scale moderation against AI threats.

Technology

• Cheap Cloning Tools: AI tools enable voice and face cloning with minimal expertise.
• High-Quality Deepfakes: Advanced AI generates highly realistic and deceptive video content.

Data Inputs

• Public Figure Media Exploitation: Abundant public footage of Rishi Sunak used to train cloning models.
• Spoofed BBC News Branding: Using trusted news branding as input data to deceive viewers.

Human Factors

• Malicious Actor Intent: Fraudsters exploiting AI to deploy deceptive financial scams.
• Voter Vulnerability: Difficulty for ordinary citizens to distinguish deepfakes from reality.

Process and Methods

• Lax Ad Moderation Processes: Meta's automated ad screening failed to detect policy-violating deepfakes.
• Delayed Threat Response: Platforms failed to swiftly remove reported illegal misinformation.

Regulatory Environment

• Lagging Electoral Laws: Electoral systems struggle to keep pace with rapid AI developments.
• Slow Policy Enforcement: Platforms lack strong regulatory pressure for immediate content removal.

Information quality

• Classification confidence: High
• Reason for confidence: The reports provide clear, consistent, and quantified details about the deepfake campaign, including the number of ads (143), the spend (£12,929), the reach (400,000), and the specific nature of the faked content (BBC newsreader and Rishi Sunak promoting an investment scam). There is little ambiguity about the events, though the exact AI models used are not specified.
• Ambiguities identified: The specific AI tools or platforms used to generate the deepfakes are not identified.

A coordinated campaign utilized generative AI to create and distribute over 100 deepfake video ads impersonating UK Prime Minister Rishi Sunak and BBC news presenters. Reaching up to 400,000 users on Meta platforms, the incident represents a substantial information security concern, demonstrating how synthetic media can be scaled to target national leadership and undermine public trust.

• Overall national security impact: Substantial
• Response level: Substantial
• Scope: Single nation
• Primary target: United Kingdom
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. The specific campaign has concluded, but the threat represents an ongoing, strategic concern regarding the scaling of synthetic media ahead of national elections.
• Autonomy: Human-controlled. AI tools were used strictly as assets by human creators to generate specific video and voice assets, with no autonomous decision-making or execution by the AI.
• Novelty: Evolved capability. Deepfakes and ad-based scams are established, but the coordinated en masse targeting of a sitting Prime Minister using synthetic media represents a significant evolutionary step.

Impact by dimension

• Physical security: Negligible. The incident was entirely digital and focused on financial fraud, presenting no threat to physical systems, critical infrastructure, or human safety.
• Information security: Substantial. Coordinated campaign utilizing over 100 high-quality deepfakes of the Prime Minister and BBC newsreaders to reach 400,000 users. Represents a substantial information operations capability that erodes trust in official communications.
• Sovereignty: Minor. While the immediate intent was financial fraud, the mass impersonation of the head of government raised significant concerns regarding potential AI-enabled election interference and manipulation of democratic processes.
• Economic security: Minor. The campaign targeted individual citizens with a fraudulent investment scam. While causing individual financial harm, it did not threaten systemic financial stability or strategic industries.
• Societal stability: Minor. The widespread dissemination of highly realistic deepfakes of trusted figures contributes to epistemic harm and the erosion of public trust in democratic institutions and media.