Arizona Residents Reportedly a Frequent Target of AI-Driven Romance Scams

Arizona residents, especially senior citizens, are reportedly often the target of AI-driven romance scams. Between 2022 and 2023, reported losses from online romance scams in Arizona totaled over $47 million, ranking the state fifth highest in the nation behind California, Florida, Texas, and New York, according to FBI Internet Crime Complaint Center data. In 2023, it has been reported that Arizonans lost $325 million owing to these scams.

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The incident involves malicious actors using AI-generated deepfakes and synthetic media to conduct targeted romance scams and defraud victims of millions of dollars.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The financial fraud is intentionally carried out by human scammers who utilize deployed AI deepfake technologies as tools to deceive their victims.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The report describes the use of 'AI-generated content such as deepfakes' (real-time face swapping and celebrity deepfakes) which falls under the Limited Risk category requiring transparency.

AI system and alleged parties

• AI system: unspecified
• AI purpose: Deepfake Video Generation; Deepfake Image Generation
• Behaviour type: Tool
• Alleged developer: Unknown voice cloning technology developers, Unknown deepfake technology developers
• Alleged deployer: Yahoo Boys, Unknown scammers, Romance scammers targeting Arizonans
• Alleged harmed parties: Senior citizens of Arizona, General public of Arizona

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Substantial. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Minor
• Financial: direct Substantial, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Minor, indirect Negligible
• Differential treatment: direct Minor, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Minor, indirect Negligible
• Epistemic: direct Minor, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Property

Reported: Yes, the reports describe a victim losing her home and cars.

Indirectly caused: One victim lost her home and cars after being manipulated into wiring thousands of dollars to a scammer.

Inferred additional harm: Other victims may have been forced to liquidate physical assets or property to pay scammers, though specific details are not provided.

Financial

Reported: Yes, the reports describe total losses of over $47 million in Arizona during 2022 and 2023, with 800 victims losing $22 million in 2023.

Directly caused: Scammers stole millions of dollars directly from victims. Based on 2023 data, the average financial loss per reported victim was over $27,000.

Inferred additional harm: Actual financial losses are likely significantly higher than reported due to victims being too embarrassed to report the crimes.

Malicious content

Reported: Yes, the reports describe the creation of deepfake video calls and fake celebrity deepfakes.

Directly caused: Scammers generated real-time face-swapping videos and fake celebrity personas to deceive victims.

Inferred additional harm: Numerous synthetic images and videos are likely generated and distributed across dating platforms to target victims.

Differential treatment

Reported: Yes, the reports note that seniors and retirees are disproportionately targeted.

Directly caused: Scammers specifically target older adults and retirees because they are perceived to have accumulated wealth and may experience isolation.

Psychological

Reported: Yes, the reports describe emotional exploitation and the psychological impact of these scams.

Directly caused: Scammers exploit victims' desire for love and companionship, causing severe emotional distress, embarrassment, and shame once the fraud is realized.

Inferred additional harm: Widespread psychological trauma, depression, and anxiety are highly likely among the hundreds of victims who lost their life savings.

Epistemic

Reported: Yes, the reports describe the creation of fake online identities and deepfakes that erode trust in digital communications.

Directly caused: Scammers used deepfakes to fabricate real-time video calls and consistent personas, misleading victims into believing they were interacting with real partners.

Inferred additional harm: The proliferation of deepfakes in romance scams contributes to a broader erosion of trust in online video, audio, and digital interactions.

People affected

• Occurrences reported: 1
• People reportedly harmed: 800
• People reportedly exposed: 1000

Potential causes

Management

• Lack of Platform Safeguards: Social media companies fail to police and block coordinated scam networks.
• Delayed Financial Freezes: Banks fail to freeze compromised accounts before funds transfer overseas.

Technology

• Real-time Face Swapping: Yahoo Boys use real-time face-swap to mimic profile photos during video calls.
• AI Identity Duplication: AI generates consistent fake personas across text, images, and video.
• Celebrity Deepfakes: AI videos of celebrities trick victims into sending money.

Data Inputs

• Social Media Footprints: Scammers harvest personal details from social media to tailor their hooks.
• Unverified Online Images: Lack of image verification allows scammers to use fake profile photos.

Human Factors

• Desire for Companionship: Loneliness drives victims to trust fast-moving online relationships.
• Targeting of Wealthy Seniors: Seniors with savings are disproportionately targeted due to financial security.
• Shame and Underreporting: Embarrassment prevents victims from reporting scams to law enforcement.

Process and Methods

• Rapid Off-Platform Migration: Scammers quickly move victims from dating apps to unmonitored text or email.
• Fast Overseas Wire Transfers: Stolen funds are moved internationally within 24 hours, preventing recovery.
• Lack of Identity Verification: Dating apps and social media lack robust identity verification systems.

Regulatory Environment

• Jurisdictional Challenges: International borders make prosecuting overseas scammers highly difficult.
• Incomplete Crime Reporting: Underreporting limits the ability of policymakers to regulate cyber fraud.

Information quality

• Classification confidence: High
• Reason for confidence: The reports provide consistent, detailed statistics from the FBI, FTC, and local authorities regarding the scale of romance scams in Arizona. While the specific AI models used are not named, the description of the technology (real-time face swapping, deepfakes) and its role in the scams is clear and unambiguous.
• Ambiguities identified: The exact AI software or platforms used by the scammers are not specified.

International cybercriminals, including the Nigerian 'Yahoo Boys', are utilizing AI-generated deepfakes and voice cloning to conduct highly convincing romance scams targeting Arizona residents, resulting in over $47 million in losses. While devastating to individual victims, the national security impact remains minor as it does not threaten critical infrastructure, sovereignty, or macroeconomic stability.

• Overall national security impact: Minor
• Scope: Multiple nations
• Primary target: United States
• Alleged perpetrator: Nigerian 'Yahoo Boys' and international scamming groups

Threat characteristics

• Imminence: Long-term. Represents an ongoing criminal capability and strategic fraud concern rather than an imminent national security crisis.
• Autonomy: Human-controlled. AI systems like face-swapping and voice cloning are used as tools directly operated by human scammers to facilitate fraud.
• Novelty: Evolved capability. Represents a significant advancement of existing romance scams through the integration of real-time deepfake video and voice cloning technologies.

Impact by dimension

• Physical security: Negligible. No physical security threat, kinetic attacks, or critical infrastructure compromise identified in the incident.
• Information security: Minor. Use of deepfakes and voice cloning is restricted to localized financial fraud rather than coordinated state-sponsored information warfare or intelligence compromise.
• Sovereignty: Negligible. No disruption to core government operations, sovereign decision-making, or electoral systems.
• Economic security: Minor. While financial losses are significant for affected individuals, totaling over $47 million in Arizona, they do not threaten overall US financial system stability or critical economic infrastructure.
• Societal stability: Minor. Scams disproportionately target seniors, causing psychological harm and financial distress, but do not present a systemic threat to nationwide societal stability or civil liberties.