Alleged Deepfake of Singapore Prime Minister Lee Hsien Loong Promotes Cryptocurrency Scam in Fake Interview

A deepfake video falsely depicted Singapore’s Prime Minister Lee Hsien Loong promoting a cryptocurrency investment scam. Scammers used AI-generated voice cloning and manipulated footage from official events to create a convincing but fraudulent video interview with China Global Television Network. Lee warned the public and urged reporting through the ScamShield Bot.

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The incident involves scammers using AI voice cloning and deepfake technology to impersonate Singaporean government officials in order to promote fraudulent cryptocurrency schemes.

Additional risk subdomains

• 3.1 False or misleading information: The deepfakes also spread false information regarding the government planning to implement a Covid-19 circuit breaker.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The risk was caused by human scammers intentionally using deployed AI deepfake generation tools to deceive the public for financial gain.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Risk Level 3. Limited Risk: The report describes AI-generated content such as deepfakes which are subject to transparency obligations under the Act.

AI system and alleged parties

• AI system: None named
• AI purpose: Deepfake Video Generation; Voice Generation
• Behaviour type: Tool
• Alleged developer: Unknown voice cloning technology developers, Unknown deepfake technology developers
• Alleged deployer: Unknown scammers, Scammers impersonating Lee Hsien Loong
• Alleged harmed parties: Lee Hsien Loong, General public of Singapore

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Minor, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Minor, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Malicious content

Reported: Yes, the report describes deepfake videos circulating online that maliciously impersonate government officials.

Directly caused: Scammers created and spread deepfake videos of PM Lee and DPM Wong on social media platforms like Facebook to promote scams.

Inferred additional harm: Additional deepfake scam videos of other officials may have been created and circulated to a wider audience.

Epistemic

Reported: Yes, the deepfakes spread false news, including a fake cryptocurrency endorsement and a false rumor about a Covid-19 circuit breaker.

Directly caused: The deepfake videos depicted PM Lee promoting a bogus crypto scheme and falsely claimed the government was planning a Covid-19 circuit breaker.

Inferred additional harm: The circulation of such highly convincing deepfakes of leaders erodes the public's ability to distinguish real official announcements from fabricated ones.

People affected

• Occurrences reported: 2
• People reportedly harmed: 2
• People reportedly exposed: 100000

Potential causes

Technology

• AI Voice and Image Mimicry: AI technology allows scammers to realistically mimic voices and images.
• Footage Manipulation Tech: Real official footage is easily transformed into convincing bogus videos.

Data Inputs

• Availability of Official Footage: Real footage taken from official events is used to create deepfakes.

Human Factors

• Public Vulnerability to Scams: Targets are enticed by promises of guaranteed investment returns.
• Lack of Public Vigilance: Difficulty in discerning real official communications from fake ones.

Process and Methods

• Online Dissemination Channels: Social media and messaging platforms allow rapid circulation of deepfakes.

Information quality

• Classification confidence: High
• Reason for confidence: The report clearly describes the nature of the deepfakes, the targets (PM Lee and DPM Wong), and the intent of the scammers (cryptocurrency fraud and spreading misinformation). There is little ambiguity regarding the AI's role as a generative tool used for malicious impersonation.
• Ambiguities identified: The specific AI models used to generate the deepfakes and the exact number of victims or financial losses are not specified.
• Alternative interpretations: None. The incident is a straightforward case of deepfake-enabled financial fraud and misinformation.

Singapore's Prime Minister and Deputy Prime Minister were targeted by sophisticated deepfakes and cloned voices to promote cryptocurrency scams and spread fake government policy news. While representing an evolved capability in generative AI exploitation, the national security impact remains minor as it was a financially motivated scam rather than a state-sponsored influence operation.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: Singapore
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. Represents an ongoing strategic concern regarding the misuse of generative AI rather than an active, imminent crisis.
• Autonomy: Human-controlled. The AI systems for voice cloning and video manipulation were used as tools directed entirely by human scammers.
• Novelty: Evolved capability. While deepfakes are an established threat, the use of highly convincing voice cloning to impersonate top state leaders for scams represents an evolved capability.

Impact by dimension

• Physical security: Negligible. No physical systems, critical infrastructure, or kinetic targets were affected by this incident.
• Information security: Minor. AI-enabled deepfakes and voice cloning were used to spread fake policy news and run scams, but there is no evidence of a coordinated foreign state-sponsored intelligence operation.
• Sovereignty: Minor. The impersonation of the Prime Minister and Deputy Prime Minister to spread fake policy news targets government communication authority, but it was managed through standard public warnings.
• Economic security: Negligible. While the deepfakes promoted cryptocurrency scams, the incident did not threaten strategic industries, financial system stability, or technological competitive advantage.
• Societal stability: Negligible. The incident involved localized scams and did not result in mass surveillance, systematic discrimination, or large-scale civil unrest.