Deepfake Videos Allegedly Use AI-Generated Voice Clone of Singapore Prime Minister Lawrence Wong to Promote Scams

Singapore Prime Minister Lawrence Wong issued a warning about AI-generated deepfake videos and voice clones falsely portraying him promoting cryptocurrency scams, money-making schemes, and PR services. The manipulated content, seen on social media, reportedly uses public footage and AI voice cloning to deceive victims. Wong urged the public to avoid engaging, report scams via ScamShield, and stay vigilant.

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The deepfakes and voice clones were created by scammers to impersonate public figures for financial gain through fraudulent cryptocurrency and investment schemes.

Additional risk subdomains

• 4.1 Disinformation, surveillance, and influence at scale: Deepfakes of Senior Minister Lee Hsien Loong commenting on international relations were created to mimic government positions, posing risks to national interests and public opinion.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The risk is caused by human malicious actors intentionally using post-deployment AI generation tools to create deepfakes for financial fraud.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Risk Level 3. Limited Risk: The report describes 'AI-generated content such as deepfakes' which pose a moderate risk and require specific transparency obligations to ensure users are informed.

AI system and alleged parties

• AI system: None named
• AI purpose: Deepfake Video Generation; Voice Generation
• Behaviour type: Tool
• Alleged developer: Unknown voice cloning technology developers, Unknown deepfake technology developers
• Alleged deployer: Unknown scammers, Scammers impersonating Lawrence Wong
• Alleged harmed parties: Lawrence Wong, General public of Singapore

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Minor, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Minor
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Minor, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Malicious content

Reported: Yes, the reports describe deepfake videos and voice clones of Singaporean leaders being created and spread on social media platforms to promote scams.

Directly caused: AI-cloned voices and deepfake videos of Prime Minister Lawrence Wong and Senior Minister Lee Hsien Loong were created and circulated on Facebook and X.

Inferred additional harm: It is likely that numerous variations of these deepfakes continue to be generated and spread across various online platforms and messaging apps.

Democracy

Reported: Yes, the reports describe deepfakes of political leaders that could mislead the public about government positions, potentially harming national interests.

Indirectly caused: Deepfake videos of Lee Hsien Loong commenting on international relations and foreign leaders were noted as dangerous and potentially harmful to Singapore's national interests.

Inferred additional harm: The proliferation of deepfakes impersonating top government officials could erode public trust in official communications and democratic institutions.

Epistemic

Reported: Yes, the reports describe the fabrication of videos and audio of political leaders to deceive the public.

Directly caused: Scammers fabricated videos of Lawrence Wong and Lee Hsien Loong endorsing cryptocurrency, investment platforms, and PR services.

Inferred additional harm: The widespread availability of high-quality deepfakes of trusted public figures makes it increasingly difficult for citizens to distinguish real government announcements from synthetic fabrications.

People affected

• Occurrences reported: 4

Potential causes

Management

• Inadequate Platform Screening: Social platforms failed to block deceptive ads using deepfaked public figures.

Technology

• AI Voice Cloning: Scammers used AI to clone the Prime Minister's voice convincingly.
• Advanced Video Manipulation: AI algorithms altered facial movements and expressions in real videos.

Data Inputs

• Exploitation of Public Footage: Real interviews of leaders were harvested to train and create deepfakes.

Human Factors

• Trust in Authority Figures: Citizens trusted the manipulated videos showing their national leaders.
• Low Detection Capability: Average users struggle to spot subtle anomalies like atypical blinking.

Process and Methods

• Algorithmic Feed Distribution: Social media algorithms promoted deepfake ads on user feeds.
• Reactive Incident Response: Mitigation relied heavily on user reports and warnings after exposure.

Regulatory Environment

• Cross-Border Jurisdictional Gaps: Online scams often originate remotely, hindering local police enforcement.

Information quality

• Classification confidence: High
• Reason for confidence: The reports clearly describe the nature of the incident, identifying the targets (Lawrence Wong and Lee Hsien Loong), the platforms used (Facebook, X), and the intent (financial scams and political impersonation). The role of AI (deepfakes and voice cloning) is explicitly stated.
• Ambiguities identified: The exact financial losses directly attributable to these specific deepfakes are not separated from general Singaporean scam statistics.
• Alternative interpretations: None. The reports consistently describe these as malicious deepfake scams.

The proliferation of AI-generated deepfakes and voice clones impersonating Singaporean leaders for financial scams and fabricated commentary on international relations poses a substantial threat to official state communication and public trust. While primarily a criminal fraud issue, the potential for political manipulation elevates its national security significance.

• Overall national security impact: Substantial
• Scope: Single nation
• Primary target: Singapore
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Near-term. The threat is active and developing, with repeated incidents targeting leadership since 2023, requiring ongoing legislative and policing responses.
• Autonomy: Human-controlled. The AI tools used to generate the cloned voices and video deepfakes are fully directed and deployed by human threat actors.
• Novelty: Established threat. Deepfake impersonation of political figures for financial scams is an established threat method that has occurred repeatedly both in Singapore and globally.

Impact by dimension

• Physical security: Negligible. No physical threat, kinetic targeting, or critical infrastructure disruption was reported in connection with these deepfakes.
• Information security: Substantial. Deepfakes of top leadership, including Senior Minister Lee Hsien Loong commenting on international relations, represent a substantial information warfare risk capable of manipulating public perception and foreign relations.
• Sovereignty: Substantial. The unauthorized simulation of the Prime Minister and Senior Minister to mimic government positions directly undermines the authority and integrity of official state communications.
• Economic security: Minor. While contributing to a broader S$1.1 billion scam epidemic in Singapore, the economic impact is dispersed across individual fraud victims rather than targeting critical financial infrastructure.
• Societal stability: Minor. The incident erodes epistemic trust and public confidence in media, but does not present immediate threats of civil unrest or systemic human rights abuses.