Purported Deepfake Advertisement Falsely Depicting Physician Endorsement Used to Sell Lipedema Cream to U.S. Patient Beth Holland

A U.S. patient, Beth Holland, reported losing money after purchasing a purported lipedema treatment, Svelta Venastra, promoted through an online advertisement that allegedly used deepfake video to falsely depict endorsements by medical professionals and public figures, including her own physician, Dr. David Amron. The reported ad circulated on Facebook and misrepresented the product's efficacy, leading Holland to spend approximately $300 on a cream that did not alleviate her condition.

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The incident involves scammers using AI-generated deepfakes of celebrities and doctors to run fraudulent medical advertisement campaigns, targeting and deceiving individuals for financial gain.

Additional risk subdomains

• 1.2 Exposure to toxic content: The deepfake ads exposed social media users to harmful, deceptive, and unapproved medical treatments.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The incident was caused by human scammers who intentionally used deployed deepfake AI tools to create deceptive advertisements and defraud consumers.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The report describes the use of AI-generated content (deepfakes), which falls under Risk Level 3 due to transparency obligations to inform users they are interacting with synthetic media.

AI system and alleged parties

• AI system: unspecified
• AI purpose: Deepfake Video Generation; Voice Generation
• Behaviour type: Tool
• Alleged developer: Unknown voice cloning technology developers, Unknown deepfake technology developers
• Alleged deployer: Unknown scammers
• Alleged harmed parties: Oprah Winfrey, Kelly Clarkson, David Amron, Carnie Wilson, Beth Holland

Harm severity

Highest direct severity in any category: Severe. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Minor, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Minor
• Epistemic: direct Minor, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Malicious content

Reported: The report explicitly describes the creation and spread of malicious deepfake videos on social media platforms.

Directly caused: Scammers created deepfake videos of doctors and celebrities to promote fake medical cures.

Indirectly caused: N/A

Inferred additional harm: Thousands of deepfake videos are likely circulating across social media platforms, exposing millions of users to deceptive content.

Psychological

Reported: The report describes emotional distress and concern from the victims.

Directly caused: N/A

Indirectly caused: Dr. Amron reported being 'aghast' at seeing his likeness used to promote fake treatments, and Beth Holland expressed distress over being scammed while desperate and in pain.

Inferred additional harm: Widespread distress, anxiety, and feelings of violation are likely among the many individuals who fell victim to these scams or had their likenesses stolen.

Epistemic

Reported: The report explicitly describes epistemic harm through the generation of highly convincing fake videos and fake certificates of compliance.

Directly caused: Deepfake videos of trusted figures like Al Roker and Dr. Amron were used to spread false medical claims, and fake FDA certificates were fabricated.

Indirectly caused: N/A

Inferred additional harm: The proliferation of indistinguishable deepfakes erodes public trust in medical professionals, media figures, and online information ecosystems.

People affected

• Occurrences reported: 1
• People reportedly harmed: 6
• People reportedly exposed: 6

Potential causes

Management

• Inadequate Risk Assessment: Platforms fail to anticipate and mitigate risks of AI-driven medical fraud.
• Prioritizing Ad Revenue: Social media platforms prioritize ad volume over rigorous safety verification.

Technology

• Advanced Deepfake Generation: Highly realistic AI-generated voices and likenesses are easy to create.
• Difficult Detection: AI technology is so advanced that deepfakes are nearly impossible to spot.

Data Inputs

• Pirated Media Footage: Scammers easily harvest real doctor and celebrity footage from the internet.
• Fake Compliance Certificates: Scammers input fabricated FDA certificates to bypass verification systems.

Human Factors

• Desperation for Relief: Patients in pain are highly susceptible to promising medical scam ads.
• Trust in Authority Figures: Victims trust deepfaked endorsements from recognized doctors and celebrities.

Process and Methods

• Inadequate Ad Moderation: Social media platforms fail to proactively block fraudulent deepfake ads.
• Ineffective Takedown Processes: Takedowns occur only after scams are reported, allowing victims to be harmed.

Regulatory Environment

• Cross-Border Jurisdictions: Scammers operate globally through shell companies, hindering law enforcement.
• Lack of Regulatory Oversight: Absence of strict regulations or enforcement on AI-generated medical ads.

Information quality

• Classification confidence: High
• Reason for confidence: The report provides clear, detailed accounts of the scam mechanism, the specific victims, the financial loss of $300, and the types of deepfakes used. The role of AI as a tool for generating deepfakes is explicitly stated.
• Ambiguities identified: The specific AI models or platforms used to generate the deepfakes are not identified.
• Alternative interpretations: None. The incident is clearly a financial scam leveraging deepfake technology.

An online consumer fraud incident where scammers used AI-generated deepfakes of medical professionals and celebrities to sell unapproved treatments. While highlighting the growing challenge of synthetic media and epistemic degradation, the incident is a cybercrime issue with negligible direct national security implications.

• Overall national security impact: Minor
• Response level: Moderate
• Scope: Multiple nations
• Primary target: United States
• Other affected: Unknown
• Alleged perpetrator: Untraceable shell companies based in East Asia

Threat characteristics

• Imminence: Long-term. Represents an ongoing cybercrime threat vector rather than an immediate national security crisis.
• Autonomy: Human-controlled. AI tools were utilized by human actors as a mechanism for content generation, lacking autonomous decision-making or execution.
• Novelty: Evolved capability. Represents an advancement of existing online scam techniques using increasingly accessible synthetic media generation tools.

Impact by dimension

• Physical security: Negligible. No direct threat to critical infrastructure, physical systems, or national safety. Health risks are localized to individual consumers of unapproved products.
• Information security: Negligible. No evidence of state-sponsored information warfare, intelligence compromise, or political disinformation campaigns.
• Sovereignty: Negligible. No impact on state authority, government operations, or constitutional processes.
• Economic security: Minor. While part of a wider illicit industry generating substantial revenue, the incident represents consumer fraud rather than a threat to strategic industries or financial systems.
• Societal stability: Minor. Contributes to epistemic harm and erodes public trust in medical professionals through deepfake technology, but does not threaten overall societal stability.