Purported AI-Manipulated News Clip Fabricates Explosion and Doctor's Murder Plot for Scam

A purported AI-manipulated video falsely showing Citizen TV anchor Swaleh Mdoe reporting on the bombing of a Kenyan doctor's home circulated widely on Facebook. The video reportedly used AI-generated audio and visuals to fabricate a conspiracy in which pharmaceutical companies targeted the doctor for promoting a "miracle cure." In reality, the explosion footage was from Ohio, the doctor was fictitious, and the content aimed to manipulate viewers into purchasing an unproven health product.

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The deepfake video was created to deceive viewers into buying a fraudulent health product, exploiting their health concerns for financial gain.

Additional risk subdomains

• 3.1 False or misleading information: The video generated and spread false claims about a medical cure and a fabricated bombing to mislead viewers.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The incident was caused by human actors intentionally using deployed deepfake generation tools to create a fraudulent video to scam users.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The report describes 'deepfake technology' used to manipulate footage. Under the EU AI Act, AI-generated content such as deepfakes falls under Limited Risk, requiring transparency obligations to inform users.

AI system and alleged parties

• AI system: None named
• AI purpose: Deepfake Video Generation; Voice Generation
• Behaviour type: Tool
• Alleged developer: Unknown voice cloning technology developers, Unknown deepfake technology developers
• Alleged deployer: Unknown scammers
• Alleged harmed parties: Swaleh Mdoe, Media integrity, General public of Kenya, Citizen TV

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Minor, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Minor, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Malicious content

Reported: Yes

Directly caused: A deepfake video was created using AI to alter the voice and lip movements of news anchor Swaleh Mdoe and a medical student to promote a scam.

Inferred additional harm: The video was shared widely on Facebook, exposing over 497,000 viewers to malicious scam content.

Epistemic

Reported: Yes

Directly caused: The video fabricated a news report claiming a doctor's house was bombed by pharmaceutical companies and falsely claimed a 'miracle cure' exists.

Inferred additional harm: The spread of this video on Facebook misleads the public, eroding trust in legitimate medical institutions and news broadcasters like Citizen TV.

People affected

• Occurrences reported: 1
• People reportedly exposed: 497000

Potential causes

Management

• Growth Over Safety Focus: Platform prioritized user engagement over proactive safety verification.

Technology

• Deepfake Voice and Lip Syncing: AI voice cloning and lip-syncing created highly realistic fake footage.
• Algorithmic Recommendation: Platform algorithms promoted the video, leading to over 497,000 views.

Data Inputs

• Stolen Video and Audio Footage: Original footage of news anchor and student doctor was used without consent.

Human Factors

• Exploitation of Patient Fears: Ailing viewers easily trust miracle cures due to fear and health concerns.
• Low Deepfake Awareness: Viewers struggled to identify subtle deepfake signs like lip-sync errors.

Process and Methods

• Weak Platform Moderation: Facebook failed to detect and remove the deepfake video before it went viral.
• Inadequate Deepfake Detection: Lack of robust automated tools to flag manipulated video and audio.

Regulatory Environment

• Lack of Deepfake Policies: Absence of strict regulations governing AI-generated health misinformation.

Information quality

• Classification confidence: High
• Reason for confidence: The fact-checking report provides clear, verified details about the deepfake nature of the video, the sources of the stolen footage, and the fraudulent intent of the campaign. There is little ambiguity regarding the events or the role of AI.
• Ambiguities identified: The specific AI tools used to generate the deepfake are not identified.

A deepfake video depicting a Kenyan news anchor was used to promote a fraudulent health product. While the video garnered significant views and spread misinformation, it constitutes a financially motivated scam with negligible to minor national security implications, rather than a coordinated state-sponsored threat.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: Kenya
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. The incident is a post-facto detected scam, representing an ongoing baseline threat of deepfake scams rather than an active, imminent national security crisis.
• Autonomy: Human-controlled. The AI was used as a tool by human actors to generate the deepfake; the system had no autonomous decision-making or execution capabilities.
• Novelty: Established threat. Deepfakes used for financial and health scams are a well-established and frequently observed threat vector globally.

Impact by dimension

• Physical security: Negligible. The incident is a financial health scam with no threat to physical systems, critical infrastructure, or kinetic military or security operations.
• Information security: Minor. While it involves deepfakes and false information, it is a localized commercial scam rather than a state-sponsored information warfare campaign targeting intelligence or national security.
• Sovereignty: Negligible. No threat to state authority, electoral systems, or core government decision-making processes.
• Economic security: Negligible. The scam targets individual consumers for minor financial fraud, with no systemic threat to financial systems, strategic industries, or technological competitive advantage.
• Societal stability: Minor. It erodes public trust in media and medical institutions and exploits vulnerable populations, but does not threaten large-scale social cohesion or civil liberties.