Purported Deepfake Reportedly Circulated on Facebook Impersonating Thai PBS World Anchors and Business Figures to Solicit Investments

A purported deepfake video circulating on Facebook allegedly used AI-generated visuals and voice synthesis to impersonate Thai PBS World anchors and prominent business figures, promoting a fraudulent "Crystallum AI" investment promising fivefold returns. The original clip was reportedly traced to a 2013 NHK report, but it misused logos and likenesses.

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The incident involved malicious actors using AI deepfake technology to impersonate trusted public figures in order to run a fraudulent investment scam on Facebook.

Additional risk subdomains

• 3.1 False or misleading information: The deepfake video generated and spread false information regarding a non-existent investment project using a fabricated news broadcast.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The incident was caused by malicious human actors intentionally using deployed AI deepfake generation tools to create a fraudulent investment advertisement.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The system is an AI-generated content tool used to create deepfakes, which under the EU AI Act poses a moderate risk and requires specific transparency obligations to ensure users are informed.

AI system and alleged parties

• AI system: HIVEMODERATION, unspecified (Hive)
• AI purpose: Deepfake Video Generation; Voice Generation
• Behaviour type: Tool
• Alleged developer: Unknown voice cloning technology developers, Unknown deepfake technology developers
• Alleged deployer: Unknown scammers, Crystallum AI
• Alleged harmed parties: Toss Chirathivat, Thai social media users, Thai PBS World, Thai investors, Thai Chamber of Commerce, Patchari Raksawong, Kalin Sarasin, General public of Thailand, Epistemic integrity, Central Group (Thailand)

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Minor, indirect Minor
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Minor, indirect Minor
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Malicious content

Reported: The report explicitly describes the creation and spread of malicious deepfake content.

Directly caused: A deepfake video was created using AI to impersonate news anchors and businesspeople to promote a fraudulent investment scheme.

Indirectly caused: The fake video was distributed as an advertisement on Facebook, receiving over 1,200 likes.

Epistemic

Reported: The report explicitly describes epistemic harm through the creation of fake news and fabricated broadcasts.

Directly caused: The deepfake fabricated a news report from Thai PBS World Tonight, replacing English reporting with synthesized Thai speech to mislead viewers.

Indirectly caused: The fake news broadcast damages the credibility of the media and news anchors, potentially leading to a decline in overall trust in the news station.

Inferred additional harm: Widespread dissemination of such deepfakes could further erode public trust in legitimate news organizations and digital media.

People affected

• Occurrences reported: 1
• People reportedly harmed: 3
• People reportedly exposed: 1200

Potential causes

Management

• Inadequate Ad Verification: Platform management failed to verify the legitimacy of the advertiser.
• Lack of Brand Monitoring: Thai PBS lacked continuous monitoring to detect logo misuse immediately.

Technology

• AI Deepfake Voice Synthesis: AI synthesized a Thai voice to impersonate the English-speaking anchor.
• AI Face and Lip Syncing: Deepfake tech modified facial movements to match the fake Thai audio.

Data Inputs

• Scraped Online Video Data: An old 2013 NHK news clip from YouTube was used as training/source data.
• Unprotected Personal Biometrics: Publicly accessible faces and voices were used without authorization.

Human Factors

• Malicious Exploitation of AI: Bad actors intentionally used AI to create a deceptive investment scam.
• Viewer Susceptibility to Scams: Viewers may trust the fake video due to realistic AI-generated elements.

Process and Methods

• Inadequate Ad Screening on Facebook: Facebook approved and distributed the deepfake video as a paid ad.
• Lack of Proactive AI Detection: No automated real-time checks stopped the fake content prior to upload.

Regulatory Environment

• Reactive Legal Framework: Laws like the Computer Crime Act only penalize after damage has occurred.

Information quality

• Classification confidence: High
• Reason for confidence: The report provides clear details about the nature of the deepfake, the platforms used, the specific individuals impersonated, and the verification process. The role of AI is explicitly verified using detection tools.
• Ambiguities identified: The exact AI tools used to generate the deepfake are not specified, and the exact number of financial victims is not quantified.
• Alternative interpretations: None. It is clearly a malicious deepfake scam.

A fraudulent Facebook ad campaign used AI deepfakes to impersonate Thai PBS news anchors and business leaders to promote a fake investment scheme. The incident represents a common cyber-enabled financial fraud threat with minor national security implications, manageable under standard law enforcement and media verification procedures.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: Thailand
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. The specific incident has been debunked, representing an ongoing strategic concern of commercial fraud rather than an immediate national crisis.
• Autonomy: Human-controlled. The AI system was used strictly as a static generation tool by human fraudsters to create the deepfake video.
• Novelty: Established threat. Deepfake-enabled financial scams impersonating trusted figures are a well-established and common vector of cybercrime.

Impact by dimension

• Physical security: Negligible. No physical systems, infrastructure, or human safety threats were involved in this incident.
• Information security: Minor. Involved AI-generated deepfakes impersonating media anchors, but the intent was financial fraud rather than state-sponsored information warfare or intelligence compromise.
• Sovereignty: Negligible. No threat to state authority, electoral systems, or core government decision-making processes.
• Economic security: Minor. Represents localized financial fraud risk targeting individuals, with no systemic threat to national financial systems or strategic industries.
• Societal stability: Minor. Violated individual rights of the impersonated public figures and posed financial risks to citizens, but did not threaten large-scale societal stability.