Scammers Allegedly Use AI-Generated Avatars to Impersonate Friends in Houston, Texas and Solicit Money

Two Houston women reported being targeted in an alleged scam involving AI-generated videos that appeared to depict trusted friends. The purported deepfake avatars were reportedly used via social media and messaging apps to solicit access codes and promote fraudulent sales. Victims are reported to have lost control of their accounts, and friends of the impersonated individuals sent money believing the videos were authentic.

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

Scammers used AI-generated deepfake videos and voice clones to impersonate trusted individuals and defraud their friends of money.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The harm was caused by human scammers intentionally using deployed AI deepfake tools to defraud victims.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The report describes the use of AI-generated content such as deepfakes, which falls under Limited Risk due to transparency obligations.

AI system and alleged parties

• AI system: unspecified
• AI purpose: Deepfake Video Generation; Voice Generation
• Behaviour type: Tool
• Alleged developer: Unknown voice cloning technology developers, Unknown deepfake technology developers
• Alleged deployer: Unknown scammers
• Alleged harmed parties: Stacey Svegliato, Sara Sandlin, General public in Houston, General public

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

People affected

• Occurrences reported: 2
• People reportedly harmed: 4
• People reportedly exposed: 15

Potential causes

Management

• Lack of Platform Response: Facebook failed to respond to reports or address the scam vector.

Technology

• AI Avatar Generation: AI tools cloned faces and voices to create realistic avatars.
• Advanced Lip-Synching: Still images were animated to match typed scripts convincingly.

Data Inputs

• Publicly Available Media: Scammers harvested public videos and photos from social media.

Human Factors

• Trust in Deepfake Identity: Victims believed the realistic video calls were their actual friends.
• Sharing of Access Codes: Victims voluntarily sent MFA codes to scammers due to deception.

Process and Methods

• Insecure Privacy Settings: Publicly accessible profiles allowed easy harvesting of media.

Information quality

• Classification confidence: High
• Reason for confidence: The report clearly outlines the scam mechanism, the role of AI deepfakes, the impact on the victims, and the financial losses. While the specific AI tool used by the scammers is not named, the expert's demonstration and explanation make the technology's role unambiguous.
• Ambiguities identified: The exact AI tool used by the scammers is not specified, and the precise amount of money stolen is described generally as 'hundreds of dollars'.
• Alternative interpretations: None. The incident is a straightforward case of AI-enabled impersonation fraud.

This incident involves localized consumer fraud in Houston, Texas, where scammers used AI-generated deepfakes to impersonate two women and steal minor sums of money from their friends. While demonstrating the growing accessibility of highly realistic AI impersonation tools, the event is a standard cybercrime case with negligible implications for national security.

• Overall national security impact: Negligible
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. Represents an ongoing consumer cybercrime capability rather than an active national security crisis requiring urgent government response.
• Autonomy: Human-controlled. The AI tool was directly controlled by human scammers who provided the input media and scripts to generate the deepfakes.
• Novelty: Evolved capability. Represents an evolution of existing cyber fraud techniques, utilizing increasingly accessible AI tools to generate realistic deepfakes from minimal source material.

Impact by dimension

• Physical security: Negligible. No physical systems, critical infrastructure, or human safety were compromised or threatened in this incident.
• Information security: Negligible. The incident involves localized financial fraud targeting individuals on social media, with no evidence of state-sponsored information warfare or compromised intelligence.
• Sovereignty: Negligible. No government operations, electoral systems, or sovereign state decisions were affected by this localized cybercrime.
• Economic security: Negligible. The financial impact was limited to minor personal fraud of a few hundred dollars, presenting no systemic threat to national economic or technological security.
• Societal stability: Negligible. The incident represents localized identity theft and fraud affecting a few individuals, with no widespread threat to societal stability or population-scale human rights.