Alleged Deepfake Scam Uses BBC Presenter Naga Munchetty’s Image to Promote Fraudulent Investment Scheme

BBC presenter Naga Munchetty was reportedly targeted in an AI-generated scam using deepfake images and fake news articles to promote a fraudulent investment scheme. Scam ads on social media allegedly featured manipulated images of Munchetty and linked to a fake BBC article directing users to a cyber trading website. The BBC legal team is reported to have taken action to remove the fraudulent site.

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The primary objective of the AI-generated deepfakes and fake news articles was to impersonate trusted individuals to defraud victims for financial gain.

Additional risk subdomains

• 1.2 Exposure to toxic content: The scammers created and distributed non-consensual sexually explicit deepfakes of high-profile women, exposing social media users to highly toxic content.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The incident was caused by human scammers intentionally deploying AI-generated deepfakes and fake articles to defraud and harass individuals.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The report describes AI-generated content such as deepfakes, which are subject to transparency obligations under the EU AI Act to ensure users are aware they are interacting with synthetic media.

AI system and alleged parties

• AI system: unspecified
• AI purpose: Deepfake Image Generation; Deepfake Video Generation
• Behaviour type: Tool
• Alleged developer: Unknown deepfake technology developers
• Alleged deployer: Unknown scammers, Scammers impersonating Naga Munchetty
• Alleged harmed parties: social media users, Naga Munchetty, Fans of Naga Munchetty, BBC

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Minor, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Minor, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Minor, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Minor
• Epistemic: direct Minor, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Financial

Reported: The report explicitly describes significant financial losses caused by the fraudulent schemes.

Directly caused: Victims of the cyber trading scams lost money, with some individuals losing 'several hundred thousand pounds'.

Inferred additional harm: Widespread financial losses across thousands of victims who fell for these highly realistic deepfake and fake news scams.

Malicious content

Reported: The report explicitly describes toxic and malicious content created and spread directly by the incident.

Directly caused: Scammers created and distributed crudely mocked-up fake nude photos and sexually explicit deepfake videos of celebrities on social media.

Inferred additional harm: Widespread proliferation of non-consensual sexual deepfakes and scam ads across social media platforms exposing millions of users to toxic content.

Civil rights

Reported: The report explicitly describes violations of personal dignity and privacy rights.

Directly caused: The creation of non-consensual sexually explicit deepfakes violated the victims' basic rights to personal dignity and bodily autonomy.

Inferred additional harm: Widespread violations of individual dignity and privacy rights for numerous women targeted by synthetic sexual content.

Psychological

Reported: The report explicitly describes psychological distress experienced by the targeted individuals.

Directly caused: Naga Munchetty reported being 'mortified and bemused' and finding the fake nude photos 'mildly upsetting' and 'extraordinarily offensive'.

Indirectly caused: Other targeted celebrities likely experienced similar distress, anxiety, and violation of dignity due to non-consensual sexual deepfakes.

Inferred additional harm: Numerous other victims of deepfake harassment and financial scams likely suffer significant psychological distress, anxiety, and trauma.

Epistemic

Reported: The report explicitly describes epistemic harm through the creation of highly deceptive fake news articles.

Directly caused: Scammers fabricated news articles complete with BBC logos and branding to deceive readers, undermining trust in credible journalism.

Inferred additional harm: Erosion of public trust in media institutions and shared reality due to the proliferation of highly convincing fake news templates and deepfakes.

People affected

• Occurrences reported: 1
• People reportedly harmed: 10
• People reportedly exposed: 3000000

Potential causes

Management

• Neglecting Safety for Profit: Platforms prioritized ad revenue over rigorous safety checks on advertisers.
• Reduced Moderation Resources: Management changes led to fewer resources dedicated to content moderation.

Technology

• AI Deepfake Tech Access: Easy access to AI tools allows scammers to generate realistic fake media.
• Inadequate Detection Tech: Platforms lack robust AI tools to automatically flag synthetic media.
• Algorithmic Ad Delivery: Algorithms optimized for engagement promoted scam ads to vulnerable users.

Data Inputs

• Stolen Likeness Data: Public images and videos of celebrities harvested to generate deepfakes.
• Spoofed Brand Assets: Scammers used BBC logos and branding to make fake articles look authentic.

Human Factors

• User Trust in Celebrities: Victims trusted the fake endorsements due to the celebrity's reputation.
• Malicious Scammer Intent: Criminals actively exploit AI to deceive users and steal money.

Process and Methods

• Flawed Ad Vetting Processes: Platforms allowed paid scam ads to run without sufficient verification.
• Slow Content Takedowns: Platforms took too long to remove reported deepfakes and scam links.

Regulatory Environment

• Weak Synthetic Media Laws: Inadequate regulatory pressure on platforms to prevent deepfake spread.
• International Jurisdictions: Scammers operated from foreign locations, complicating law enforcement.

Information quality

• Classification confidence: High
• Reason for confidence: The reports provide clear, first-hand accounts from a victim (Naga Munchetty) and details of investigations by the BBC and Which? regarding the scams. The role of AI in generating the deepfakes is explicitly discussed, and the financial and psychological harms are well-documented.
• Ambiguities identified: The specific AI models or platforms used to generate the deepfakes are not identified.

AI-generated deepfakes of high-profile figures and fake news articles mimicking the BBC were used in sophisticated financial scams. While causing significant individual financial loss and psychological distress, the incident represents a serious cybercrime and regulatory challenge rather than a direct threat to national security.

• Overall national security impact: Minor
• Scope: Multiple nations
• Primary target: United Kingdom
• Other affected: United States
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. Represents an ongoing, persistent threat of fraudulent campaigns rather than an immediate, acute national security crisis.
• Autonomy: Human-controlled. AI was utilized strictly as a tool by human actors to generate synthetic media, with humans controlling the deployment and follow-up scam operations.
• Novelty: Evolved capability. Combines existing deepfake generation technology with sophisticated brand impersonation and offshore fraud networks, representing an evolution of established cyber scam techniques.

Impact by dimension

• Physical security: Negligible. No physical threat, kinetic attacks, or critical infrastructure disruption occurred or was threatened in this incident.
• Information security: Minor. AI-generated deepfakes and fake BBC articles were used to deceive the public. While highly deceptive, this was a financially motivated cybercrime rather than a state-sponsored information warfare campaign.
• Sovereignty: Negligible. No state authority, electoral systems, or core government decision-making processes were targeted or compromised.
• Economic security: Minor. The incident involved significant financial fraud targeting individuals, with some losing hundreds of thousands of pounds, but it does not threaten systemic national economic stability or strategic industries.
• Societal stability: Minor. The proliferation of non-consensual sexual deepfakes of prominent women violates personal dignity and privacy, representing a concerning trend in algorithmic harassment, though manageable under standard legal frameworks.