Purportedly AI-Altered Video Reportedly Falsely Portrayed a Slovenian Surgeon Endorsing Detoxil Water, a Supposed Parasite Remedy

An AI-generated deepfake video was used to impersonate a Slovenian oncology surgeon, Erik Brecelj, to promote a fraudulent parasite remedy called 'Detoxil Water'. The video manipulated genuine footage of the surgeon to include false health claims, leading the Medical Chamber of Slovenia to file a criminal complaint. This incident is part of a broader pattern of identity theft targeting medical professionals in Slovenia for fraudulent advertising.

The Medical Chamber of Slovenia reported that an AI-altered video falsely depicted oncology surgeon Erik Brecelj endorsing Detoxil Water, a product promoted with unsubstantiated claims about parasites. The chamber said the video reused genuine footage but changed its audio and message, and later stated that it had filed a criminal complaint. The advertisers have not been identified, and consumer injuries from this video have not been verified.

Source: AI Incident Database

Risk classification

  • Primary risk domain: 4 Malicious actors
  • Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The AI system was used to impersonate a trusted medical professional to deceive consumers into buying fraudulent health products, which constitutes a scam for personal financial gain.

Additional risk subdomains

  • 1.2 Exposure to toxic content: The deepfake video exposed users to unsafe and scientifically unfounded medical advice regarding parasite treatments, which could seriously endanger public health.

Causal factors

  • Entity: Human
  • Intent: Intentional
  • Timing: Post-deployment

The incident was driven by malicious human actors who intentionally utilized deployed AI media synthesis tools to create deceptive deepfake advertisements for financial gain.

EU AI Act risk tier

  • Risk tier: 3 Limited Risk

Limited Risk: The report describes the use of AI-generated deepfakes. Under the EU AI Act, systems that generate or manipulate image, audio or video content (deepfakes) are subject to transparency obligations to ensure users are informed.

AI system and alleged parties

  • AI system: None named
  • AI purpose: Deepfake Video Generation; Voice Generation
  • Behaviour type: Tool
  • Alleged developer: Synthetic video generation technology developers, Synthetic media generation technology developers, Synthetic audio generation technology developers, Deepfake technology developers
  • Alleged deployer: Synthetic media creators, Scammers, Impersonation scammers, Deepfake creators
  • Alleged harmed parties: Viewers of deceptive medical advertising, Victims of impersonation scams, People seeking medical advice, Erik Brecelj, Epistemic integrity

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

  • Physical: direct Negligible, indirect Negligible
  • Infrastructure: direct Negligible, indirect Negligible
  • Property: direct Negligible, indirect Negligible
  • Financial: direct Negligible, indirect Negligible
  • Environmental: direct Negligible, indirect Negligible
  • Malicious content: direct Minor, indirect Minor
  • Differential treatment: direct Negligible, indirect Negligible
  • Civil rights: direct Negligible, indirect Negligible
  • Democracy: direct Negligible, indirect Negligible
  • Privacy: direct Minor, indirect Negligible
  • Psychological: direct Negligible, indirect Minor
  • Epistemic: direct Minor, indirect Substantial
  • Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Malicious content

Reported: The report explicitly describes toxic or malicious content created and spread directly by the incident.

Directly caused: AI was used to generate deepfake videos manipulating Dr. Brecelj's voice and appearance to promote fraudulent products.

Indirectly caused: The deepfake videos were distributed as ads on Facebook and Instagram, reaching an unknown number of social media users.

Inferred additional harm: Similar deepfake ads targeting other Slovenian medical professionals were likely created and distributed across social media platforms.

Privacy

Reported: The report explicitly describes privacy violations and identity theft caused directly by the incident.

Directly caused: Dr. Brecelj's personal identity and professional likeness were stolen and manipulated without his consent, leading to a police complaint for abuse of personal data.

Inferred additional harm: The personal contact information (phone numbers) of consumers who interacted with the ads was harvested and abused for aggressive telemarketing.

Psychological

Reported: The report explicitly describes psychological distress and harassment caused indirectly by the incident.

Indirectly caused: One reader experienced distress and harassment, receiving over 50 unsolicited phone calls after entering her contact details on the fraudulent ad.

Inferred additional harm: Dr. Brecelj and other targeted doctors likely experienced distress and reputational anxiety due to their professional authority being used to promote dangerous medical scams.

Epistemic

Reported: The report explicitly describes epistemic harm caused directly and indirectly by the incident.

Directly caused: The AI-generated deepfakes fabricated statements from Dr. Brecelj, falsely claiming that '8 out of 10 diseases related to aging are caused by parasites' and that Detoxil Water 'destroys 98% of parasites in 72 hours'.

Indirectly caused: The campaign eroded public trust in the medical profession and official health recommendations by creating a false impression of expert endorsement.

Inferred additional harm: The proliferation of such highly convincing medical deepfakes threatens to permanently degrade public trust in health authorities and scientific consensus.

People affected

  • Occurrences reported: 2
  • People reportedly harmed: 2
  • People reportedly exposed: 2

Potential causes

Management

  • Platform Profit Over Safety: Social networks hosted harmful ads for revenue without robust verification.

Technology

  • AI Deepfake Synthesis: AI tools cloned doctor's voice and altered video to create realistic clip.
  • High Fidelity Generative AI: Advanced AI made the fake video look and sound highly convincing to users.

Data Inputs

  • Harvesting of Public Media: Real footage from a GOVSI podcast was hijacked and fed into AI tools.
  • Identity Theft of Doctors: Real names and likenesses were stolen to back up the synthesized content.

Human Factors

  • Abuse of Professional Trust: Scammers exploited public trust in doctors and medical authority.
  • Targeting Vulnerable Patients: Ads targeted people desperate for quick health cures and solutions.
  • Low Digital Literacy on Deepfakes: Consumers could not easily distinguish AI-cloned voices from real ones.

Process and Methods

  • Weak Social Media Ad Vetting: Platforms published fraudulent ads without verifying doctor's consent.
  • Global Scam Infrastructure: Scammers operated from Vietnam and Seychelles to bypass local actions.
  • Slow Enforcement Action: Reporting to police and inspectors had no immediate effect on active ads.

Regulatory Environment

  • Inadequate Platform Oversight: Regulators lacked mechanisms to force platforms to block deepfake ads.
  • Jurisdictional Barriers: Offshore operations made it difficult for local authorities to prosecute.

Information quality

  • Classification confidence: High
  • Reason for confidence: The reports from multiple credible sources consistently describe the nature of the deepfake scam, the specific medical professional targeted, the product promoted, and the legal actions taken. The role of AI in generating the voice and video is explicitly stated.
  • Ambiguities identified: The specific AI tools or platforms used to generate the deepfakes are not identified.
  • Alternative interpretations: None. The incident is clearly a financially motivated cyber-enabled fraud utilizing synthetic media.

An AI-generated deepfake campaign impersonated a prominent Slovenian surgeon to promote fraudulent health products. While concerning for public health trust and individual privacy, the incident is a localized consumer scam with negligible direct national security implications.

  • Overall national security impact: Minor
  • Scope: Single nation
  • Primary target: Slovenia
  • Alleged perpetrator: Offshore scammers operating from Vietnam

Threat characteristics

  • Imminence: Long-term. Represents an ongoing, persistent threat of cyber-enabled consumer fraud rather than an active national security crisis.
  • Autonomy: Human-controlled. The AI system was used as a media generation tool by human operators, with no autonomous decision-making or execution.
  • Novelty: Evolved capability. Represents an evolution of traditional consumer fraud, leveraging highly convincing voice and video deepfakes of local trusted figures to bypass traditional skepticism.

Impact by dimension

  • Physical security: Negligible. No physical attacks, critical infrastructure manipulation, or kinetic threats occurred in connection with this commercial fraud incident.
  • Information security: Negligible. While synthetic media was utilized, the campaign was a financially motivated consumer scam rather than a state-sponsored information warfare or intelligence operation.
  • Sovereignty: Negligible. No disruption to core government operations, electoral systems, or state sovereignty was reported.
  • Economic security: Negligible. The financial impact is limited to individual consumer fraud and does not threaten national economic systems, strategic industries, or technological advantages.
  • Societal stability: Minor. The incident involves identity theft of prominent medical figures to spread false health advice, which poses a minor risk to public health trust but is manageable via standard law enforcement.
Explore in the interactive Incident Tracker