Chinese Actor and CPPCC Member Jin Dong Allegedly Impersonated by AI Deepfake Scammers to Mislead and Defraud Fans

Jin Dong, an actor from China and a member of the Chinese People's Political Consultative Conference (CPPCC), has warned about criminals using deepfake technology to impersonate him. The scammers are reportedly using his likeness and cloning his voice to deceive and defraud elderly individuals. In addition to his warning, Jin Dong has called for legislation and tech regulations to curb AI abuse.

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

Criminals utilized AI deepfake technology to clone the voice and likeness of actor Jin Dong to target and defraud elderly individuals for financial and emotional gain.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The fraud was carried out by human criminals who intentionally used deployed AI deepfake tools to impersonate the actor and deceive victims.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The system involves AI-generated content such as deepfakes, which under the EU AI Act are subject to specific transparency obligations to ensure users are aware they are interacting with synthetic media.

AI system and alleged parties

• AI system: None named
• AI purpose: Deepfake Video Generation; Voice Generation
• Behaviour type: Tool
• Alleged developer: Unknown voice cloning technology developers, Unknown deepfake technology developers
• Alleged deployer: Unknown scammers, Scammers impersonating Jin Dong
• Alleged harmed parties: General public of China, Fans of Jin Dong, Elderly individuals in China, Elderly individuals

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Minor
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Minor, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Minor, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Minor
• Epistemic: direct Minor, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Financial

Reported: Yes, the report explicitly mentions severe property losses and scams, though no specific monetary figures are provided.

Indirectly caused: Victims suffered financial losses from being defrauded by scammers using the AI deepfakes, though the exact monetary value is not specified in the report.

Inferred additional harm: Given the typical scale of celebrity impersonation scams, it is likely that total financial losses across all victims reach hundreds of thousands of yuan.

Malicious content

Reported: Yes, the report describes the creation of fake images and voices using AI face-swapping and voice-cloning technologies to commit fraud.

Directly caused: Scammers generated synthetic videos and audio clips impersonating actor Jin Dong to deceive his audience.

Inferred additional harm: It is likely that numerous deepfake videos and audio recordings were distributed across various social media and messaging platforms to target elderly users.

Civil rights

Reported: Yes, the report mentions the need to protect citizens' personality rights and property rights.

Directly caused: The unauthorized synthesis of Jin Dong's voice and likeness violated his personality rights, while the fraud violated the property rights of the victims.

Inferred additional harm: It is likely that the personality rights of other public figures and the civil rights of many elderly citizens continue to be violated by similar unregulated deepfake operations.

Psychological

Reported: Yes, the report explicitly mentions emotional losses and public anxiety.

Indirectly caused: Elderly fans suffered emotional losses and distress due to being deceived by fake personas of the actor.

Inferred additional harm: It is likely that dozens of elderly victims experienced severe emotional distress, confusion, and anxiety upon realizing they were defrauded by synthetic media.

Epistemic

Reported: Yes, the report describes the creation of fake images and voices that misled audience members into believing they were interacting with the real actor.

Directly caused: The AI face-swapping and voice-cloning technology fabricated a false reality, misleading elderly fans into believing the fake persona was the real Jin Dong.

Inferred additional harm: The proliferation of such deepfakes likely erodes public trust in digital media and video evidence, making it harder for users to distinguish real public figures from synthetic ones.

People affected

• Occurrences reported: 1
• People reportedly harmed: 10
• People reportedly exposed: 100

Potential causes

Management

• Insufficient Platform Oversight: Social platforms fail to manage and remove fraudulent AI content.

Technology

• AI Face-Swapping Tech: Deepfake algorithms easily clone facial features of celebrities.
• Voice Cloning Tech: AI voice synthesis replicates celebrity voices realistically.

Data Inputs

• Publicly Available Media: Abundant public video and audio of celebrities feed training data.

Human Factors

• Low Digital Literacy: Elderly viewers struggle to distinguish deepfakes from reality.
• Emotional Vulnerability: Victims seek emotional connection, making them susceptible to scams.

Process and Methods

• Weak Verification Processes: Platforms lack robust real-time deepfake detection methods.

Regulatory Environment

• Inadequate AI Legislation: Lack of specific laws targeting AI face-swap and voice abuse.
• Weak Technical Supervision: Regulatory bodies lack tools to monitor and enforce AI abuse.

Information quality

• Classification confidence: High
• Reason for confidence: The report clearly outlines the nature of the AI abuse (deepfake impersonation for fraud), the target audience (elderly fans), and the resulting harms (financial and emotional). The application of the boundary rules (specifically B1 for deepfake fraud) makes the domain classification highly straightforward.
• Ambiguities identified: The specific AI models, platforms, or developers used to generate the deepfakes are not identified.
• Alternative interpretations: None. The incident is a clear-cut case of deepfake-enabled financial fraud.

Criminals in China used AI deepfakes to impersonate actor Jin Dong to defraud elderly fans. While the incident highlights growing public anxiety over synthetic media and prompted calls for legislative action at a national political session, its direct national security impact remains minor, as it constitutes localized criminal fraud rather than state-sponsored information warfare or systemic threat.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: China
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. Represents an ongoing strategic and regulatory concern regarding consumer fraud rather than an immediate national security crisis.
• Autonomy: Human-controlled. The AI face-swapping and voice-cloning tools were directly operated by human criminals to execute fraud, with no autonomous decision-making by the AI.
• Novelty: Established threat. Deepfake-enabled celebrity impersonation and financial fraud targeting vulnerable populations is an established and widely observed threat.

Impact by dimension

• Physical security: Negligible. No physical security threat, kinetic attacks, or critical infrastructure compromise reported in this incident.
• Information security: Minor. While deepfakes were used to mislead citizens, the primary intent was localized financial fraud rather than systematic, state-sponsored information warfare or intelligence compromise.
• Sovereignty: Negligible. No disruption to core government operations, state authority, or electoral processes reported, despite the issue being discussed at a national political advisory session.
• Economic security: Minor. Localized financial fraud targeting elderly citizens occurred, but it did not threaten strategic industries, national financial systems, or technological competitive advantage.
• Societal stability: Minor. The deepfake scams caused public anxiety and violated individual personality and property rights, but did not result in large-scale civil unrest or systematic algorithmic oppression.