Foreign scammers, identified as 'Yahoo Boys' and groups in Morocco, are using AI-generated images of U.S. military personnel to create fake social media profiles. These profiles are used to target vulnerable individuals, particularly widows, in long-term romance scams. Victims are manipulated into sending large sums of money via untraceable methods, with reported losses reaching hundreds of thousands of dollars per individual.
Yahoo Boys (from Nigeria and Ghana) and scammers from Morocco are reportedly targeting U.S. widows and vulnerable individuals using AI-generated images and fake military profiles in "Artificial Patriot" scams. They have allegedly impersonated military officials such as General Matthew W. McFarlane to gain trust, sharing fabricated backstories and emotional appeals. Once trust is established, they request money through untraceable methods.
Risk classification
- Primary risk domain: 4 Malicious actors
- Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation
Scammers are using AI-generated images to create fake military profiles to conduct targeted romance scams and defraud vulnerable individuals of their life savings.
Additional risk subdomains
- 3.1 False or misleading information: AI-generated synthetic images were used to create highly convincing fake profiles that misled victims into believing they were communicating with real military personnel.
Causal factors
- Entity: Human
- Intent: Intentional
- Timing: Post-deployment
The harm is caused by human scammers who intentionally use post-deployment AI image generation tools to create fake profiles and defraud victims.
EU AI Act risk tier
- Risk tier: 3 Limited Risk
Limited Risk: The report describes the creation and dissemination of AI-generated content such as deepfakes, which requires transparency obligations so users are aware they are interacting with synthetic media.
AI system and alleged parties
- AI system: unspecified AI image generator
- AI purpose: Deepfake Image Generation; Image Generation
- Behaviour type: Tool
- Alleged developer: Unknown voice cloning technology developers, Unknown deepfake technology developers
- Alleged deployer: Yahoo Boys, Scammers from West Africa, Scammers from Nigeria, Scammers from Morocco, Scammers from Ghana, Brouteurs
- Alleged harmed parties: Widows, Truth, National security and intelligence stakeholders, Matthew W. McFarlane, Impersonated American military officials, Epistemic integrity, Emotionally vulnerable individuals, American widows
Harm severity
Severity ratings are based on this scale.
Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
- Physical: direct Negligible, indirect Substantial
- Infrastructure: direct Negligible, indirect Negligible
- Property: direct Negligible, indirect Negligible
- Financial: direct Negligible, indirect Minor
- Environmental: direct Negligible, indirect Negligible
- Malicious content: direct Minor, indirect Minor
- Differential treatment: direct Negligible, indirect Minor
- Civil rights: direct Negligible, indirect Negligible
- Democracy: direct Negligible, indirect Negligible
- Privacy: direct Negligible, indirect Minor
- Psychological: direct Negligible, indirect Minor
- Epistemic: direct Minor, indirect Substantial
- Child sexual exploitation and abuse: direct Negligible, indirect Negligible
Physical
Reported: The report explicitly describes one fatality caused indirectly by the scam.
Indirectly caused: A woman in Italy committed suicide after losing her entire life savings of 200,000 euros to the scammers.
Inferred additional harm: It is likely that other victims of these devastating financial and emotional scams experienced severe physical health deterioration or self-harm, though specific details are not available.
Financial
Reported: The report explicitly describes massive financial losses suffered by individual victims.
Indirectly caused: Individual victims suffered massive financial losses, including Wasserman who lost over $130,000 and an Italian victim who lost 200,000 euros, averaging over $150,000 per detailed occurrence.
Inferred additional harm: With nearly 70,000 romance scams reported in 2022 totaling $1.3 billion in losses, it is inferred that total financial losses from AI-facilitated military romance scams run into tens of millions of dollars.
Malicious content
Reported: The report explicitly describes the creation and spread of AI-generated fake images used as engagement bait.
Directly caused: AI models were used to generate thousands of deceptive, fake photographs of wounded soldiers, veterans, and military babies to act as engagement bait.
Indirectly caused: These AI-generated images were spread across dozens of foreign-run patriotic Facebook pages, reaching tens of thousands of social media users.
Inferred additional harm: It is likely that millions of social media users are regularly exposed to similar AI-generated deceptive content designed to manipulate engagement and trust.
Differential treatment
Reported: The report explicitly describes scammers targeting vulnerable widows.
Indirectly caused: Scammers systematically targeted vulnerable U.S. widows, exploiting their emotional vulnerability and relationship status for financial gain.
Inferred additional harm: It is inferred that elderly and socially isolated individuals, particularly widows, are disproportionately targeted and harmed by these AI-enabled romance scams.
Privacy
Reported: The report explicitly describes privacy violations through the impersonation of real military personnel.
Indirectly caused: Real military personnel, such as retired General McFarlane, had their names, photos, and biographical details stolen and used to create hundreds of fake accounts without consent.
Inferred additional harm: Thousands of active and retired military personnel likely have had their public likenesses and personal details scraped and exploited to facilitate these scams.
Psychological
Reported: The report explicitly describes severe emotional and psychological harm to the victims.
Indirectly caused: Victims experienced severe emotional distress, described by one moderator as 'emotional and financial rape', with some victims suffering from extreme grief, betrayal, and trauma.
Inferred additional harm: Given the thousands of romance scams occurring, it is inferred that thousands of victims suffer from severe depression, anxiety, and trauma due to targeted emotional manipulation.
Epistemic
Reported: The report explicitly describes epistemic harm through the creation of highly realistic fake profiles and images.
Directly caused: AI was used to generate highly realistic but entirely fabricated images of military personnel, creating false evidence of non-existent individuals.
Indirectly caused: The proliferation of these fake profiles and images has eroded trust in online military communities and made it difficult for users to distinguish real service members from AI-generated fakes.
Inferred additional harm: The widespread use of AI-generated synthetic media for impersonation is likely causing a systemic decline in public trust in online information and digital identities.
People affected
- Occurrences reported: 1
- People reportedly harmed: 5
- People reportedly exposed: 50000
Potential causes
Management
- Prioritizing Engagement Over Safety: Meta's algorithm promoted engagement bait to increase user platform time.
- Under-resourced Moderation Teams: Meta failed to allocate enough human reviewers to handle the scale of clones.
- Defensive Corporate Stance: Meta suggested victims fix issues themselves instead of taking responsibility.
Technology
- AI Image Generation Tools: Generates realistic but flawed images of soldiers used as engagement bait.
- Algorithmic Recommendation Engine: Facebook's algorithm served more AI images, amplifying scam reach.
- Inadequate Automated Detection: Meta's systems failed to automatically detect and block AI-generated bait.
Data Inputs
- Scraped Real Military Photos: Scammers harvested real generals' photos from government and social sites.
- Public Relationship Statuses: Widow status on profiles allowed scammers to target vulnerable users.
- Pre-written Scam Playbooks: Scripts and formats provided templates for convincing interactions.
Human Factors
- Emotional Vulnerability: Widows and lonely individuals seeking companionship fell for romance scams.
- Lack of Digital Literacy: Victims could not identify subtle AI image artifacts like extra fingers.
- High Trust in Military Personnel: Patriotic victims naturally trusted profiles claiming to be U.S. soldiers.
Process and Methods
- Inadequate Profile Verification: Platforms allowed easy creation of fake profiles posing as generals.
- Flawed Impersonation Reporting: Real generals' authentic accounts were shut down instead of fake clones.
- Whack-a-Mole Mitigation: Reactive removal of fake accounts was too slow to counter rapid creation.
Regulatory Environment
- Inadequate Law Enforcement Action: Local police and FBI struggle to investigate overseas cyber criminals.
- Lack of Platform Accountability: No strict regulations holding platforms liable for hosting scam networks.
Information quality
- Classification confidence: High
- Reason for confidence: The reports provide detailed, consistent accounts of how scammers use AI-generated images to facilitate romance scams, including specific victim testimonies, financial loss figures, and statements from impersonated military personnel. The role of AI in generating synthetic images to bolster fake profiles is clearly described.
- Ambiguities identified: The specific AI image generation models used by the scammers are not named.
- Alternative interpretations: The scams could be viewed as traditional cybercrime where AI is merely an incidental tool, rather than an AI-driven safety incident.
Foreign scammers are utilizing AI-generated synthetic images of U.S. military personnel to conduct highly effective romance scams. While the financial and psychological toll on individual victims is severe, the national security impact remains minor, primarily representing an evolved capability of transnational financial crime rather than a direct threat to state security.
- Overall national security impact: Minor
- Scope: Multiple nations
- Primary target: United States
- Other affected: Italy
- Alleged perpetrator: Foreign scammers including Yahoo Boys and groups in Morocco
Threat characteristics
- Imminence: Long-term. Represents an ongoing strategic and law enforcement concern rather than an immediate national security crisis.
- Autonomy: Human-controlled. AI tools are used by human operators to generate static images, while the actual communication and deception are executed manually.
- Novelty: Evolved capability. Romance scams and military impersonation are established threats, but the integration of AI-generated synthetic media represents a significant evolutionary step.
Impact by dimension
- Physical security: Negligible. No physical kinetic attacks or critical infrastructure threats were reported.
- Information security: Minor. Military personnel identities, including a retired General, were cloned at scale, but the activity is financially motivated fraud rather than state-sponsored intelligence compromise.
- Sovereignty: Negligible. No direct threat to state authority, elections, or core government decision-making processes.
- Economic security: Minor. Individual financial losses are severe, reaching hundreds of thousands of dollars per victim, but the activity does not threaten national financial systems or strategic industries.
- Societal stability: Minor. The scams cause severe psychological distress and individual tragedies, such as suicide, but do not threaten broad societal stability or civil liberties.