Purported Oprah Deepfake Reportedly Induced Utah Woman to Buy Misrepresented Weight Loss Supplements

A Utah woman, Lisa Swearingen, reported paying more than $400 for weight loss supplements after seeing online ads featuring a purported Oprah Winfrey deepfake endorsement. When the product arrived, she said its primary ingredient was turmeric rather than the advertised formula.

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The incident involves bad actors using an AI-generated deepfake of a celebrity (Oprah Winfrey) to run a fraudulent weight-loss supplement scam, directly targeting consumers for financial gain.

Additional risk subdomains

• 6.3 Economic and cultural devaluation of human effort: The deepfake harms the celebrity's reputation and marketability by undermining the trust in their real words and endorsements.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The incident was caused by human bad actors intentionally using AI deepfake technology post-deployment to defraud consumers.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The report describes the use of AI-generated deepfakes. According to the definitions, 'AI-generated content such as deepfakes' falls under Risk Level 3 (Limited Risk) which requires transparency obligations to inform users.

AI system and alleged parties

• AI system: unspecified
• AI purpose: Deepfake Video Generation; Social Media Content Generation
• Behaviour type: Tool
• Alleged developer: Unknown voice cloning technology developers, Unknown deepfake technology developers
• Alleged deployer: Unknown scammers, Unknown advertisers, Prozenith
• Alleged harmed parties: People seeking weight loss supplements, People seeking medical advice, Oprah Winfrey, Lisa Swearingen, Epistemic integrity

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Minor, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Negligible, indirect Minor
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Malicious content

Reported: The report describes the creation and spread of AI deepfake videos of Oprah Winfrey on TikTok and Reels to promote a scam.

Directly caused: AI deepfake videos of Oprah Winfrey were generated and distributed on social media platforms to deceive users.

Inferred additional harm: It is highly likely that numerous other celebrity deepfakes are being generated and spread across social media platforms for similar malicious purposes.

Epistemic

Reported: The report describes the erosion of trust in real celebrity words and the difficulty in distinguishing real videos from deepfakes.

Directly caused: The deepfake video misled Swearingen into believing Oprah Winfrey endorsed the weight loss product.

Indirectly caused: The proliferation of deepfakes causes people to lose trust in bona fide videos, making real words lose power and marketability.

Inferred additional harm: Widespread use of celebrity deepfakes is likely causing a broader erosion of shared truth and trust in digital media content.

People affected

• Occurrences reported: 1
• People reportedly harmed: 2
• People reportedly exposed: 2

Potential causes

Management

• Lack of Seller Responsiveness: Seller ignored customer complaints and evaded accountability.

Technology

• Realistic Deepfake Generation: AI tools generate highly realistic celebrity deepfakes that are hard to spot.
• Low Resource Requirements: Deepfakes can be created using relatively little source material.

Data Inputs

• Abundant Public Video Data: Vast online footage of celebrities makes training deepfake models easy.
• Lack of Content Provenance Data: No digital labels or metadata exist to verify if video is AI-generated.

Human Factors

• Trust in Celebrity Likeness: Consumers trust endorsements from recognizable public figures like Oprah.
• Difficulty Spotting Fraud: Consumers struggle to identify highly sophisticated AI-generated deepfakes.

Process and Methods

• Inadequate Ad Verification: Social media platforms lack effective processes to filter deepfake scam ads.
• Deliberately Vague Websites: Seller websites use vague details to obscure true product ingredients.

Regulatory Environment

• Lack of Labeling Regulations: Absence of laws forcing platforms to label AI-generated content.

Information quality

• Classification confidence: High
• Reason for confidence: The reports provide clear details about the scam, the victim's financial loss, the use of an Oprah Winfrey deepfake, and Oprah's public response. The role of the AI (deepfake generation) is explicitly stated, and the harm is well-documented.
• Ambiguities identified: The specific AI tool or platform used to generate the deepfake is not identified.

A consumer fraud incident involving an AI-generated deepfake of celebrity Oprah Winfrey to sell weight-loss supplements. While highlighting the growing ease of creating deceptive synthetic media, the incident is a localized commercial scam with negligible national security implications.

• Overall national security impact: Negligible
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. The incident represents an ongoing, widespread capability trend of commercial deepfake fraud rather than an active national security crisis.
• Autonomy: Human-controlled. The AI system was used as a generation tool under direct human control to create the deepfake video.
• Novelty: Established threat. AI-generated celebrity deepfakes used for online scams and consumer fraud are a well-documented and established threat.

Impact by dimension

• Physical security: Negligible. No physical threat, kinetic attacks, or infrastructure disruption occurred in this incident.
• Information security: Negligible. The deepfake was used for commercial consumer fraud rather than state-sponsored information warfare or targeting of intelligence capabilities.
• Sovereignty: Negligible. No impact on government decision-making, electoral systems, or sovereign state functions.
• Economic security: Negligible. The incident is a localized consumer scam with no impact on strategic industries, financial systems, or national economic security.
• Societal stability: Negligible. While eroding trust in digital media, the scam does not represent a large-scale threat to societal stability, civil liberties, or human rights.