A man in Brazil was arrested after using AI software to create a fake photograph of himself holding a pistol. He sent this image to his former partner via WhatsApp to intimidate her and her father. Police searches confirmed no real firearm existed, and the suspect confessed to using AI to simulate the weapon for the purpose of domestic intimidation.
A man allegedly used an AI-altered photograph of himself holding a pistol to threaten his former partner and her father in Santa Helena de Goiás, Brazil. Police reportedly arrested him in nearby Rio Verde after the woman sought help. He reportedly said he used AI to simulate a weapon; a local report said police had not confirmed his explanation. Searches reportedly found no firearm.
Risk classification
- Primary risk domain: 4 Malicious actors
- Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation
The suspect used AI to generate a fake image of himself holding a gun to manipulate the victim's beliefs (making her believe he was armed) and intimidate her, representing targeted coercion.
Additional risk subdomains
- 1.2 Exposure to toxic content: The victim was directly exposed to abusive, threatening, and unsafe synthetic content depicting a weapon.
Causal factors
- Entity: Human
- Intent: Intentional
- Timing: Post-deployment
The harm was caused by a human user who intentionally used a deployed AI image generation tool to create a threatening fake photo for domestic intimidation.
EU AI Act risk tier
- Risk tier: 3 Limited Risk
Limited Risk: The system used was an AI image generator capable of creating synthetic content (deepfakes/manipulated images), which falls under transparency obligations for AI-generated content.
AI system and alleged parties
- AI system: None named
- AI purpose: Deepfake Image Generation; Image Generation
- Behaviour type: Tool
- Alleged developer: Synthetic media technology developers, Synthetic image generation technology developers
- Alleged deployer: Synthetic media creators, Men and boys, Men, Domestic abuse perpetrators
- Alleged harmed parties: Women and girls, Women, Family members of domestic violence victims, Epistemic integrity, Domestic violence victims
Harm severity
Severity ratings are based on this scale.
Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
- Physical: direct Negligible, indirect Negligible
- Infrastructure: direct Negligible, indirect Negligible
- Property: direct Negligible, indirect Negligible
- Financial: direct Negligible, indirect Negligible
- Environmental: direct Negligible, indirect Negligible
- Malicious content: direct Minor, indirect Negligible
- Differential treatment: direct Negligible, indirect Negligible
- Civil rights: direct Negligible, indirect Negligible
- Democracy: direct Negligible, indirect Negligible
- Privacy: direct Negligible, indirect Negligible
- Psychological: direct Minor, indirect Negligible
- Epistemic: direct Negligible, indirect Negligible
- Child sexual exploitation and abuse: direct Negligible, indirect Negligible
Malicious content
Reported: The report explicitly describes toxic and malicious content created and spread directly by the incident.
Directly caused: One synthetic image depicting a threat of violence (a man holding a gun) was generated and sent to one recipient via WhatsApp.
Psychological
Reported: The report explicitly describes psychological harm in the form of intimidation and threats directed at the victim and her father.
Directly caused: The victim suffered immediate psychological distress, fear, and intimidation upon receiving the threatening image of her ex-partner holding a gun.
Inferred additional harm: The victim and her father likely suffered ongoing anxiety, trauma, and fear for their personal safety following the targeted threat.
People affected
- Occurrences reported: 1
- People reportedly harmed: 2
- People reportedly exposed: 2
Potential causes
Management
- Deficient AI Policy Enforcement: AI developer failed to monitor and block abusive prompt patterns.
Technology
- Unrestricted Weapon Synthesis: AI tools generated a realistic firearm without safety guardrails.
- Lack of Image Provenance: Generated threat image lacked metadata or watermarks to signal AI origin.
Data Inputs
- Integration of Real Photos: AI accepted real personal photos to overlay synthesized weapons seamlessly.
Human Factors
- Intentional Malicious Use: Perpetrator weaponized AI-generated content to terrorize ex-partner.
Process and Methods
- Exploitation of View-Once Media: Using temporary WhatsApp messages to hide the AI threat from authorities.
Regulatory Environment
- Inadequate AI Threat Regulation: Lack of strict legal frameworks governing AI-facilitated domestic abuse.
Information quality
- Classification confidence: High
- Reason for confidence: The report clearly details the incident, the suspect's confession, the method of using AI to generate the fake gun, and the police response. There is little ambiguity regarding the events or the role of the AI.
- Ambiguities identified: The specific AI software or platform used to generate the image is not identified.
A localized domestic violence incident in Brazil where an individual used AI image generation to fake a photo of himself with a gun to threaten his ex-partner. The incident has negligible national security implications and was resolved entirely by local law enforcement.
- Overall national security impact: Minor
- Scope: Single nation
- Primary target: Brazil
- Alleged perpetrator: Individual
Threat characteristics
- Imminence: Long-term. The threat is resolved as the suspect has been arrested by local police, leaving no active national security threat.
- Autonomy: Human-controlled. The AI system functioned strictly as a human-controlled tool for image generation without autonomous decision-making.
- Novelty: Established threat. The use of image manipulation and digital fabrication for personal harassment and threats is an established threat method.
Impact by dimension
- Physical security: Negligible. No physical threat to critical infrastructure or public safety was posed, as police confirmed the suspect did not possess a real weapon.
- Information security: Negligible. No national-scale information warfare or intelligence compromise occurred; the incident was a localized case of personal intimidation.
- Sovereignty: Negligible. No threat to state authority, government functions, or electoral systems was identified.
- Economic security: Negligible. No impact on financial systems, strategic technologies, or economic stability.
- Societal stability: Minor. Represents a localized violation of personal safety and civil rights through domestic violence, which was successfully managed by standard local law enforcement procedures.