Reported AI-Generated Deepfake Videos Impersonating Elon Musk and Dragon’s Den Allegedly Used in Cryptocurrency Investment Scam Targeting Canadian Victims

Two Canadian investors lost a combined $2.3 million to a sophisticated cryptocurrency investment scam that utilized AI-generated deepfake videos of Elon Musk and the television program Dragon's Den. The scammers used these videos alongside fabricated investment dashboards to build trust and persuade victims to transfer large sums of money. The report highlights the growing threat of industrial-scale fraud operations that leverage AI to manipulate victims.

Two Canadian investors in Ontario and Prince Edward Island reportedly lost a combined $2.3 million after being deceived by purportedly AI-generated deepfake videos impersonating Elon Musk and the television program Dragon's Den. The reported videos and fabricated online dashboards allegedly persuaded the victims to transfer funds into a fraudulent cryptocurrency investment scheme that displayed fake profits and blocked withdrawals.

Source: AI Incident Database

Risk classification

  • Primary risk domain: 4 Malicious actors
  • Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The incident involves malicious actors using AI-generated deepfakes of public figures to conduct highly targeted financial scams and fraud against specific victims.

Causal factors

  • Entity: Human
  • Intent: Intentional
  • Timing: Post-deployment

The harm was caused by human scammers intentionally deploying AI-generated deepfake videos to defraud victims.

EU AI Act risk tier

  • Risk tier: 3 Limited Risk

Limited Risk: The report describes the use of AI-generated content such as deepfakes, which falls under Risk Level 3 and is subject to specific transparency obligations under the Act.

AI system and alleged parties

  • AI system: None named
  • AI purpose: Deepfake Video Generation; Voice Generation
  • Behaviour type: Tool
  • Alleged developer: Unknown voice cloning technology developers, Unknown deepfake technology developers
  • Alleged deployer: Unknown scammers impersonating Elon Musk, Unknown scammers
  • Alleged harmed parties: Unnamed resident from Prince Edward Island, Unnamed resident from Markham, Ontario, General public of Canada, General public, Epistemic integrity, Elon Musk, Dragon's Den, Canadian investors

Harm severity

Highest direct severity in any category: Severe. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

  • Physical: direct Negligible, indirect Minor
  • Infrastructure: direct Negligible, indirect Negligible
  • Property: direct Negligible, indirect Negligible
  • Financial: direct Substantial, indirect Minor
  • Environmental: direct Negligible, indirect Negligible
  • Malicious content: direct Minor, indirect Negligible
  • Differential treatment: direct Negligible, indirect Minor
  • Civil rights: direct Negligible, indirect Substantial
  • Democracy: direct Negligible, indirect Negligible
  • Privacy: direct Negligible, indirect Negligible
  • Psychological: direct Negligible, indirect Minor
  • Epistemic: direct Minor, indirect Minor
  • Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Physical

Reported: The report explicitly describes physical harm in the form of beatings and torture of trafficked workers in Southeast Asian scam compounds.

Directly caused: N/A

Indirectly caused: Workers trafficked to Southeast Asian cyber fraud compounds face beatings or torture if they refuse to work or try to escape.

Inferred additional harm: N/A

Financial

Reported: The report describes two occurrences causing a total financial loss of $2.3 million, with an average loss of $1.15 million per occurrence.

Directly caused: The Ontario victim lost $1.7 million and the Prince Edward Island victim lost $600,000 directly to the scam, averaging $1.15 million per victim.

Indirectly caused: The Ontario victim borrowed $500,000 from family and friends and maxed out credit cards, spreading the financial strain to her personal network.

Inferred additional harm: Given that Canadians have lost $1.2 billion to investment scams over three years, it is highly likely that many other individuals have suffered unquantified financial losses from similar deepfake scams.

Malicious content

Reported: The report explicitly describes malicious deepfake videos created to facilitate the fraud.

Directly caused: AI-generated deepfake videos of Elon Musk and Dragon's Den were created and distributed on social media platforms like Facebook to deceive targets.

Indirectly caused: N/A

Inferred additional harm: It is highly likely that numerous other malicious deepfake videos are actively circulating on social media platforms to target other potential victims.

Differential treatment

Reported: The report explicitly notes that fraud rings increasingly target specific vulnerable demographics.

Directly caused: N/A

Indirectly caused: The fraud rings selectively targeted Black homeowners and retirees for these predatory schemes.

Inferred additional harm: N/A

Civil rights

Reported: The report explicitly describes severe human rights violations associated with the operation of these scams.

Directly caused: N/A

Indirectly caused: The industrial-scale cyber fraud compounds rely on human trafficking and forced labor, violating the basic civil and human rights of the workers.

Inferred additional harm: Thousands of individuals may be held in conditions of modern slavery and forced labor within these global scam networks.

Psychological

Reported: The report explicitly describes psychological harm, noting the scam was designed to drain victims emotionally.

Directly caused: N/A

Indirectly caused: The Ontario victim suffered severe emotional distress and stood to lose her home after being scammed out of her life savings.

Inferred additional harm: Widespread psychological trauma, anxiety, and depression are highly likely for both victims due to the catastrophic financial losses and loss of home equity.

Epistemic

Reported: The report explicitly describes epistemic harm through the creation of highly convincing fake endorsements.

Directly caused: AI-generated deepfake videos fabricated endorsements from Elon Musk and Dragon's Den, misleading victims into believing the schemes were legitimate.

Indirectly caused: The proliferation of cheap deepfake tools makes it increasingly difficult for ordinary investors to distinguish real opportunities from fraud, eroding trust in digital information.

Inferred additional harm: N/A

People affected

  • Occurrences reported: 2
  • People reportedly harmed: 2
  • People reportedly exposed: 2

Potential causes

Management

  • Inadequate AI Risk Monitoring: Platform management failed to monitor risks of AI-enabled ad fraud.

Technology

  • Realistic Deepfake Generation: AI-generated videos of celebrities like Elon Musk deceived victims.
  • Accessible Deepfake Tools: Cheap and accessible tools enable widespread creation of convincing scams.

Data Inputs

  • Manipulated Media Inputs: Use of realistic celebrity likenesses and voices as input data for ads.

Human Factors

  • Trust in AI Celebrity Endorsements: Victims believed fake AI endorsements from trusted figures like Elon Musk.
  • Overreliance on Video Authenticity: Victims assumed highly realistic video content on social media was authentic.

Process and Methods

  • Flawed Deepfake Detection: Social media platforms lacked effective processes to detect AI-generated ads.

Regulatory Environment

  • Lack of Deepfake Regulations: Absence of strict legal frameworks governing AI-generated media.

Information quality

  • Classification confidence: High
  • Reason for confidence: The reports provide clear, detailed, and consistent accounts of the two victims, the specific financial losses, the platforms used, and the broader context of industrial-scale cyber fraud. The role of AI deepfakes is explicitly defined.
  • Ambiguities identified: The specific AI models or software platforms used to generate the deepfakes are not identified in the reports.

AI-generated deepfakes of public figures were utilized by Southeast Asian cyber fraud networks to scam Canadian citizens out of 2.3 million dollars. While representing severe financial and psychological harm to individuals and highlighting links to human trafficking, the incident poses minor direct threats to national security.

  • Overall national security impact: Minor
  • Response level: Moderate
  • Scope: Multiple nations
  • Primary target: Canada
  • Other affected: Southeast Asian nations
  • Alleged perpetrator: Southeast Asian cyber fraud networks

Threat characteristics

  • Imminence: Long-term. Represents an ongoing strategic cybercrime threat rather than an immediate national security crisis.
  • Autonomy: Human-controlled. AI was used as a generation tool by human actors who controlled the overall scam operations.
  • Novelty: Evolved capability. Represents an evolved capability where deepfakes are integrated into industrial-scale organized crime operations.

Impact by dimension

  • Physical security: Negligible. No direct threats to physical systems, critical infrastructure, or kinetic military capabilities identified in the incident.
  • Information security: Minor. Use of AI deepfakes for financial fraud rather than coordinated state-sponsored disinformation campaigns or intelligence compromise.
  • Sovereignty: Negligible. No disruption to core government functions, electoral systems, or sovereign decision-making processes.
  • Economic security: Minor. Direct financial losses of 2.3 million dollars to individual citizens, representing minor overall impact on national economic security.
  • Societal stability: Minor. Highlights connection to Southeast Asian cyber fraud networks relying on human trafficking, alongside targeted financial victimization of citizens.
Explore in the interactive Incident Tracker