Salt Lake City Police Chief Mike Brown's Voice and Image Misused in AI-Generated Scam

A scammer used AI to create a deepfake video of Salt Lake City Police Chief Mike Brown, falsely claiming that a recipient owed $100,000 to the federal government. The video, sent via email from a fake SLCPD account, used a cloned voice and repurposed footage from a past interview.

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The incident involves scammers using AI voice-cloning technology to impersonate police officers and family members to commit targeted fraud and extortion.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The scam was orchestrated by human actors who intentionally used deployed AI voice-cloning technology to create a fraudulent video for extortion.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Risk Level 3. Limited Risk: The reports describe the use of 'AI-generated content such as deepfakes' and 'voice cloning' to impersonate individuals, which falls under the transparency obligations of Limited Risk systems.

AI system and alleged parties

• AI system: unspecified
• AI purpose: Voice Generation; Deepfake Video Generation
• Behaviour type: Tool
• Alleged developer: Unknown deepfake technology developers
• Alleged deployer: Unknown scammers, Unknown deepfake creators
• Alleged harmed parties: Woods Cross residents, Salt Lake City residents, Mike Brown

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

People affected

• Occurrences reported: 3
• People reportedly harmed: 5
• People reportedly exposed: 10

Potential causes

Management

• Rapid Tech Release: AI developers release powerful cloning tools with few safeguards.
• Inadequate Media Protection: Organizations fail to protect official media from manipulation.
• Lack of Public Education: Organizations fail to adequately warn citizens of AI-cloned scams.

Technology

• Advanced Voice Cloning Tech: AI tools can realistically clone voices from short audio clips.
• Deepfake Video Manipulation: Scammers synced cloned audio with old video footage.
• Caller ID Spoofing: Scammers easily spoofed phone numbers to look like police.

Data Inputs

• Public Media Exploitation: Scammers harvested old TV interviews from the internet.
• Social Media Oversharing: Publicly shared personal audio and video provide training data.

Human Factors

• Susceptibility to Urgency: Scammers exploit fear and urgency to bypass critical thinking.
• Trust in Authority Figures: Victims comply when targeted by impersonated police chiefs.
• Oversharing of Personal Data: People share details online, aiding customized scams.

Process and Methods

• Weak Email Verification: Scammers used generic Google accounts instead of official domains.
• Lack of Immediate Verification: Victims often act before verifying caller identity.
• Spoofed Caller IDs: Scammers exploit telecom vulnerabilities to spoof police numbers.

Regulatory Environment

• Unregulated AI Tool Access: Powerful voice-cloning tools are easily accessible online.
• Irreversible Payment Methods: Scammers demand wire transfers or crypto, preventing recovery.
• Lack of AI Watermarking: No enforced standards for watermarking generated synthetic audio.

Information quality

• Classification confidence: High
• Reason for confidence: The reports provide clear, consistent details about the nature of the scams, the technology used (voice cloning and deepfakes), and the specific targets. There is no conflicting information regarding how the AI was used.
• Ambiguities identified: The exact AI models or software platforms used by the scammers are not specified in the text, though the extraction context identifies OpenAI.
• Alternative interpretations: None. The events are clearly identified as malicious impersonation scams.

Criminal actors leveraged AI-generated voice cloning and deepfake video technology to impersonate local police officials in extortion attempts targeting citizens in the US and India. While representing an evolution in fraud tactics and a minor threat to local public trust, the incident remains a localized criminal matter with negligible direct impact on national security.

• Overall national security impact: Minor
• Scope: Multiple nations
• Primary target: United States
• Other affected: India
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. Represents an ongoing, evolving capability and strategic concern regarding criminal use of AI, rather than an active national security crisis.
• Autonomy: Human-controlled. The AI voice-cloning tools were directly controlled and deployed by human scammers to generate specific fraudulent content.
• Novelty: Evolved capability. Represents a significant advancement in the sophistication of traditional imposter scams by integrating highly realistic AI voice and video cloning.

Impact by dimension

• Physical security: Negligible. The incident is a financial scam targeting individuals and does not impact physical systems, critical infrastructure, or human safety.
• Information security: Minor. Involves AI-cloned media impersonating law enforcement leadership, representing a minor localized information integrity threat, but lacks national security scale or foreign state-actor involvement.
• Sovereignty: Minor. Scammers impersonated municipal police leadership to extort citizens, representing a minor threat to local government authority and public trust in official communications.
• Economic security: Negligible. The incident involves localized financial fraud targeting individuals, with no impact on strategic industries, national financial systems, or technological security.
• Societal stability: Minor. Targeted extortion caused psychological distress to individual victims and erodes public trust in communications, but does not threaten societal stability on a national scale.