Purported Deepfake Ads Reportedly Fabricated BBC Question Time Confrontations Between Andrew Bailey and Nigel Farage

Purported AI-generated ads on X reportedly depicted Bank of England governor Andrew Bailey and Reform UK leader Nigel Farage in fabricated physical confrontations on a BBC Question Time-style set. The ads allegedly used the staged Bailey-Farage clash to present an investment scam as legitimate BBC-style financial journalism.

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The incident involves the use of AI-generated deepfakes of public figures to run fraudulent investment scams, which directly aligns with fraud, scams, and targeted manipulation under Domain 4.

Additional risk subdomains

• 1.2 Exposure to toxic content: The deepfake videos depict public figures in violent physical confrontations, including holding a gun and kicking, exposing users to toxic and fabricated violent content.
• 3.1 False or misleading information: The campaign generates and spreads false narratives and fake news articles about public figures to mislead the public.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The risk is caused by human malicious actors who intentionally created and distributed deepfake advertisements post-deployment to defraud the public.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The report describes the use of AI-generated content such as deepfakes, which under the EU AI Act are classified as limited risk and subject to specific transparency obligations to ensure users are informed of their synthetic nature.

AI system and alleged parties

• AI system: None named
• AI purpose: Deepfake Video Generation; Deepfake Image Generation
• Behaviour type: Tool
• Alleged developer: Video generation technology developers, Synthetic media technology developers, Image generation technology developers, Deepfake technology developers
• Alleged deployer: X (Twitter) ad buyers, Scammers, News media impersonation actors, Malvertising actors, Investment scam operators
• Alleged harmed parties: X (Twitter) users, Potential investors, People targeted by financial scams, Nigel Farage, Epistemic integrity, BBC, Bank of England, Andrew Bailey

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Minor, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Minor, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Malicious content

Reported: Yes, the report explicitly describes the creation and spread of deepfake videos showing violent physical confrontations and a public figure holding a gun.

Directly caused: AI-generated deepfake videos and images depicting Andrew Bailey and Nigel Farage in physical fights, with Farage holding a gun or kicking Bailey, were spread across dozens of X accounts.

Inferred additional harm: It is likely that similar violent or malicious deepfake ads targeting other public figures were generated and distributed across other social media platforms, exposing thousands of additional users.

Epistemic

Reported: Yes, the report describes the generation of false news articles and deepfake videos that fabricate events, such as a physical confrontation on BBC's Question Time.

Directly caused: Fabricated news stories with headlines like 'How Andrew Bailey the Bank of England's Elite Secret Live on Television' and deepfake videos of non-existent physical clashes were distributed to mislead users.

Inferred additional harm: The widespread dissemination of highly convincing deepfakes of central bank governors and public figures likely erodes public trust in official institutions and media sources, affecting thousands of viewers.

People affected

• Occurrences reported: 1
• People reportedly harmed: 7
• People reportedly exposed: 10000

Potential causes

Management

• Drastic Safety Staff Cuts: X gutted safety teams by eighty percent, reducing moderation capacity.

Technology

• Convincing Deepfake AI: AI tools enabled highly realistic fake videos of public figures.
• Ad Security Evasion: Scammers bypassed automated security filters on social platforms.

Data Inputs

• Misuse of Likeness Data: Scammers used images of public figures without authorization.

Human Factors

• Vulnerability to Scams: Vulnerable online users are easily exploited by deceptive ads.
• Over-reliance on User Reports: Platform relies on users to report scams rather than proactive detection.

Process and Methods

• Slow Content Moderation: Fake ads remain online for days before being successfully removed.
• Flawed Ad Review Process: Inadequate screening allowed fraudulent deepfake ads to go live.

Regulatory Environment

• Weak Regulatory Enforcement: Watchdogs lack the power to enforce immediate removal of fake ads.

Information quality

• Classification confidence: High
• Reason for confidence: The report clearly details the nature of the deepfake scam, the platforms involved, the specific public figures targeted, and the fraudulent intent. There is no ambiguity about the fact that these are AI-generated deepfakes used for financial scams.
• Ambiguities identified: The specific AI tools or models used to generate the deepfakes are not identified in the report.
• Alternative interpretations: None. The evidence clearly points to a financially motivated cyber-scam using synthetic media.

A coordinated global financial fraud campaign utilizing sophisticated AI-generated deepfakes of central bank governors and political figures to lure victims into investment scams. Suspected to be run by a Russian-language criminal network, the incident highlights the evolving threat of synthetic media to institutional trust and economic security, though it does not pose an imminent threat to physical infrastructure.

• Overall national security impact: Minor
• Scope: Multiple nations
• Primary target: United Kingdom
• Other affected: Greece, Belgium
• Alleged perpetrator: Russian-language criminal network

Threat characteristics

• Imminence: Near-term. The campaign is actively running across social media platforms, requiring ongoing monitoring and mitigation by security and moderation teams.
• Autonomy: Human-controlled. AI tools were used as static generation instruments by human operators who designed, directed, and distributed the content.
• Novelty: Evolved capability. Deepfake financial scams are an established threat, but this represents an evolved capability in terms of coordination, targeting of central bankers, and depicting simulated violence.

Impact by dimension

• Physical security: Negligible. No physical systems, critical infrastructure, or human safety were threatened or impacted by this digital scam campaign.
• Information security: Minor. Involves coordinated deepfake campaigns impersonating high-profile financial and political figures, but the primary motive appears to be financial fraud rather than state-directed information warfare.
• Sovereignty: Minor. Impersonation of central bank governors and political figures targets public trust in state institutions, but does not directly compromise core government decision-making or operations.
• Economic security: Minor. While targeting central bank governors to execute financial scams, the incident represents opportunistic fraud rather than a systemic cyberattack on financial infrastructure.
• Societal stability: Minor. Widespread distribution of deepfakes of public figures on social media contributes to epistemic erosion and public distrust, though it does not cause large-scale civil unrest.