Scammers Allegedly Manipulate 2023 Speech of Singapore Senior Minister Lee Hsien Loong to Spread Deepfake Investment Fraud

A new deepfake video falsely showed Prime Minister Lee Hsien Loong endorsing an investment product with guaranteed returns. Scammers synchronized fake audio with real footage from his 2023 National Day speech, making it appear as though he had made the endorsement. Lee called this “extremely worrying” and warned that deepfake scams are becoming more sophisticated. He urged the public to report such scams through the government’s ScamShield Bot.

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The incident involves scammers using AI-generated deepfakes to impersonate a public official for the purpose of promoting a fraudulent investment scam.

Additional risk subdomains

• 3.1 False or misleading information: The deepfake video generates highly realistic but entirely false information, depicting the minister making statements he never made.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The risk was caused by the intentional actions of human scammers deploying deepfake technology to defraud the public.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Risk Level 3: Limited Risk. The report describes the use of AI to create a deepfake video, which falls under AI-generated content requiring transparency obligations under the EU AI Act.

AI system and alleged parties

• AI system: None named
• AI purpose: Deepfake Video Generation; Voice Generation
• Behaviour type: Tool
• Alleged developer: Unknown voice cloning technology developers, Unknown deepfake technology developers
• Alleged deployer: Unknown scammers, Scammers impersonating Lee Hsien Loong
• Alleged harmed parties: Lee Hsien Loong, General public of Singapore

Harm severity

Highest direct severity in any category: Substantial. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Minor, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Minor, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Malicious content

Reported: The report explicitly describes malicious content created and spread directly by the incident.

Directly caused: Scammers created and circulated a deepfake video of Senior Minister Lee Hsien Loong on Facebook to promote a fraudulent investment product.

Indirectly caused: N/A

Inferred additional harm: It is likely that similar malicious deepfake videos targeting other public figures are being generated and shared across social media.

Epistemic

Reported: The report explicitly describes epistemic harm through the creation of a highly realistic deepfake video.

Directly caused: The scammers synchronized the minister's mouth movements with AI-generated audio to fabricate an endorsement he never made.

Indirectly caused: N/A

Inferred additional harm: The proliferation of realistic deepfakes of public officials degrades the shared information ecosystem, making it harder for citizens to trust authentic communications.

People affected

• Occurrences reported: 1
• People reportedly harmed: 1
• People reportedly exposed: 1000

Potential causes

Technology

• Advanced Deepfake Generation: Scammers mimicked voice and synchronized mouth movements with real footage.
• AI Voice Synthesis: AI tools allowed realistic replication of the minister's voice.

Data Inputs

• Exploitation of Public Footage: Scammers used actual 2023 National Day message and CGTN interview footage.

Human Factors

• Trust in Public Figures: Citizens may be fooled thinking a trusted public official endorsed the product.
• Lack of Public Vigilance: Public vulnerability to high-yield investment scams.

Process and Methods

• Ineffective Platform Filtering: Social media platforms allowed deepfake scam ads to be published and run.
• Reactive Reporting Mechanisms: Reliance on post-facto reporting tools like ScamShield Bot.

Information quality

• Classification confidence: High
• Reason for confidence: The report clearly describes the nature of the incident, the specific individual targeted, the medium used, and the technology. There is little ambiguity about what transpired.
• Ambiguities identified: The specific AI tools or platforms used by the scammers to generate the deepfake are not identified.
• Alternative interpretations: None. It is clearly a malicious impersonation scam using deepfake technology.

Scammers used sophisticated AI deepfake technology to impersonate Singapore Senior Minister Lee Hsien Loong in a fraudulent investment video. While representing a worrying trend in synthetic media and epistemic harm, the incident is a financially motivated scam with minor national security implications, manageable through standard law enforcement and public awareness channels.

• Overall national security impact: Minor
• Response level: Moderate
• Scope: Single nation
• Primary target: Singapore
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. Represents an ongoing strategic concern regarding deepfake technology rather than an active, immediate crisis.
• Autonomy: Human-controlled. The AI system was used as a tool by human scammers to generate content, operating entirely under human direction.
• Novelty: Established threat. Similar deepfake scams targeting the same official and other global leaders have been documented previously.

Impact by dimension

• Physical security: Negligible. No physical systems, critical infrastructure, or human safety elements were impacted or threatened by this incident.
• Information security: Minor. Involves a sophisticated deepfake of a high-profile official, but is a financially motivated scam rather than a coordinated state-sponsored information warfare campaign.
• Sovereignty: Minor. Impersonation of a senior minister could undermine public trust in official communications, but did not disrupt core government operations or decision-making.
• Economic security: Minor. The incident is an investment scam targeting individuals, which poses minor economic risks but does not threaten national financial stability or strategic industries.
• Societal stability: Minor. The proliferation of realistic deepfakes of public officials contributes to epistemic harm and erodes trust in information, but caused no civil unrest.