The use of AI-enhanced and AI-generated imagery in political discourse regarding Iranian human rights abuses has created a 'liar's dividend' effect. By mixing authentic photographs of political prisoners with AI-enhanced or entirely synthetic imagery, political actors have inadvertently provided the Iranian judiciary with a pretext to dismiss all human rights documentation as fabricated. This degradation of the evidentiary record obscures the reality of ongoing state violence and harms the credibility of legitimate human rights advocacy.
A purportedly AI-edited collage of eight Iranian women political prisoners was reportedly amplified by President Donald Trump and U.S. government accounts alongside an unverified claim that all faced imminent execution. Reporting said the images were of real women but had been AI-enhanced, while later Iranian official mockery used AI-generated women. The episode reportedly blurred authentic human-rights documentation with synthetic material and helped Iran dismiss underlying abuses.
Risk classification
- Primary risk domain: 4 Malicious actors
- Primary risk subdomain: 4.1 Disinformation, surveillance, and influence at scale
The incident involves coordinated and at-scale political influence and propaganda by state and non-state actors using AI-altered and AI-generated content to manipulate public opinion regarding human rights.
Additional risk subdomains
- 3.2 Pollution of information ecosystem and loss of consensus reality: The mixing of authentic and synthetic content erodes the credibility of real human rights documentation, leading to a 'liar's dividend' where audiences withdraw in skepticism.
Causal factors
- Entity: Human
- Intent: Intentional
- Timing: Post-deployment
The risk was caused by human actors intentionally using AI tools to enhance or generate images for political propaganda and trolling post-deployment.
EU AI Act risk tier
- Risk tier: 3 Limited Risk
Risk Level 3: Limited Risk. The incident involves AI-generated content and deepfakes, which are subject to transparency and labeling obligations under the EU AI Act.
AI system and alleged parties
- AI system: AI photo editing software, ChatGPT, unspecified AI generator (OpenAI)
- AI purpose: Image Generation; Image Retouching
- Behaviour type: Tool
- Alleged developer: Unknown AI image-editing technology developers
- Alleged deployer: White House, United States Department of State, Iranian Embassy in South Africa, Eyal Yakoby, Donald Trump
- Alleged harmed parties: Venus Hossein-Nejad, Panah Movahedi, Mahboubeh Shabani, Golnaz Naraghi, Ghazal Ghalandari, Epistemic integrity, Ensieh Nejati, Diana Taherabadi, Bita Hemmati
Harm severity
Severity ratings are based on this scale.
Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
- Physical: direct Negligible, indirect Negligible
- Infrastructure: direct Negligible, indirect Negligible
- Property: direct Negligible, indirect Negligible
- Financial: direct Negligible, indirect Negligible
- Environmental: direct Negligible, indirect Negligible
- Malicious content: direct Minor, indirect Severe
- Differential treatment: direct Negligible, indirect Negligible
- Civil rights: direct Negligible, indirect Minor
- Democracy: direct Negligible, indirect Minor
- Privacy: direct Negligible, indirect Negligible
- Psychological: direct Negligible, indirect Minor
- Epistemic: direct Minor, indirect Severe
- Child sexual exploitation and abuse: direct Negligible, indirect Negligible
Malicious content
Reported: The report explicitly describes the creation and spread of AI-enhanced and AI-generated propaganda.
Directly caused: The Iranian Embassy in South Africa posted a grid of eight AI-generated images of Iranian girls in hijab mocking the situation, and Trump shared an AI-enhanced collage of eight women's faces.
Indirectly caused: The amplification of these images across Truth Social, X, and Instagram, reaching millions of users.
Inferred additional harm: Widespread proliferation of synthetic propaganda by state and non-state actors.
Civil rights
Reported: The report explicitly describes how the incident undermines the defense of political prisoners and violates their rights.
Indirectly caused: The Iranian judiciary used the AI-enhanced/synthetic nature of the images to dismiss real human rights abuses, directly undermining the legal defense and human rights of the eight imprisoned women.
Inferred additional harm: Thousands of other political prisoners in Iran face a higher risk of rights violations and executions as the credible record of state violence is systematically corroded.
Democracy
Reported: The report explicitly describes the erosion of diplomatic credibility and the manipulation of public opinion.
Directly caused: The US State Department's Persian-language account translated and republished unverified, AI-enhanced content, carrying a faulty narrative into the diplomatic record.
Indirectly caused: The Iranian regime weaponized the synthetic material to deny state violence, undermining international accountability and democratic oversight of human rights.
Inferred additional harm: Long-term erosion of trust in international human rights advocacy and democratic institutions' ability to verify information.
Psychological
Reported: The report describes the families and the women facing increased precarity and danger, which causes severe distress.
Indirectly caused: The families of the eight women face severe anxiety and distress as their cases are dismissed as 'fake news' and their defense becomes harder.
Inferred additional harm: Widespread distress among families of political prisoners in Iran whose cases are being dismissed due to the 'liar's dividend'.
Epistemic
Reported: The report explicitly describes epistemic harm, specifically the 'liar's dividend' and the erosion of shared truth.
Directly caused: Trump shared an AI-enhanced collage with a false narrative about imminent executions, and the Iranian Embassy posted ChatGPT-generated fake images of girls.
Indirectly caused: Audiences are unable to distinguish authentic from synthetic content, leading to skepticism and withdrawal from the information environment.
Inferred additional harm: Widespread pollution of the information ecosystem regarding geopolitical conflicts, making it extremely difficult to establish consensus reality.
People affected
- Occurrences reported: 1
- People reportedly harmed: 8
- People reportedly exposed: 1000000
Potential causes
Management
- Prioritizing Speed Over Accuracy: US government feeds amplified posts rapidly without checking AI authenticity.
- Underinvestment in Fact-Checking: Platforms and organizations underfund crisis-specific AI verification.
- Slow Policy Implementation: Platforms fail to translate Oversight Board AI recommendations into action.
Technology
- Ubiquitous AI Photo Editing: AI retouching built into standard software leaves traces on authentic photos.
- Generative AI Propaganda Tools: AI models allow rapid generation of synthetic videos and images for propaganda.
- Inadequate Platform Detection: Social media platforms lack effective tools to detect and label AI content.
Data Inputs
- Lack of Provenance Metadata: Images lack built-in cryptographic signals showing their authentic origin.
- AI-Enhanced Visual Artifacts: Smoothing and stylized backgrounds mimic fully synthetic AI-generated images.
- Unverified Social Media Feeds: Plentiful unverified digital media feeds are ingested without verification.
Human Factors
- Confirmation Bias in Sharing: Political figures share unverified AI-enhanced content to fit narratives.
- Erosion of Public Trust: Audiences withdraw and dismiss real human rights abuses as AI fabrications.
- Lack of AI Literacy: Users cannot distinguish between AI-enhanced and fully AI-generated images.
Process and Methods
- Deficient Verification Work: No human rights or journalistic verification was done before amplification.
- Inconsistent Platform Labeling: Meta and X fail to consistently label AI-generated content during crises.
- Weak Content Moderation: Platforms lack resources to separate synthetic from authentic media in crises.
Regulatory Environment
- Absence of Provenance Standards: Lack of mandated standards for content provenance at the point of creation.
- Lack of Platform Accountability: No regulatory enforcement of platform policies regarding AI-generated media.
- Weak Crisis Response Policies: Regulators fail to mandate fast guardrails during geopolitical crises.
Information quality
- Classification confidence: High
- Reason for confidence: The report provides highly detailed, verified journalistic analysis of the specific posts, the political context, and the names of the affected individuals, allowing for precise classification.
- Ambiguities identified: The specific AI tools used for the initial image enhancement are not named, though ChatGPT is explicitly identified for the subsequent generation.
- Alternative interpretations: The incident could be viewed purely as a political disinformation campaign, but the central role of AI-generated and AI-enhanced content in creating the 'liar's dividend' makes it an AI safety issue.
The incident demonstrates the 'liar's dividend' in a geopolitical context, where the mixing of authentic and synthetic AI-generated content allowed the Iranian regime to dismiss genuine documentation of state violence. This erodes the credibility of international human rights advocacy and misleads democratic diplomatic institutions, representing a substantial information warfare and societal stability threat.
- Overall national security impact: Substantial
- Scope: Multiple nations
- Primary target: Iran
- Other affected: United States
- Alleged perpetrator: Iranian Government and US political actors
Threat characteristics
- Imminence: Long-term. Represents an ongoing strategic and systemic vulnerability in international information verification rather than an immediate, localized physical crisis.
- Autonomy: Human-controlled. Human actors intentionally utilized AI image generation and enhancement tools to create and disseminate political propaganda.
- Novelty: Evolved capability. Represents a significant advancement in how state adversaries weaponize the existence of generative AI to dismiss legitimate evidence of human rights abuses.
Impact by dimension
- Physical security: Negligible. No physical infrastructure, kinetic systems, or human safety assets were directly targeted or compromised by the AI-generated imagery.
- Information security: Substantial. State actors and high-profile political figures utilized AI-generated and enhanced media to pollute the diplomatic information ecosystem, successfully discrediting legitimate human rights documentation.
- Sovereignty: Minor. US State Department communication channels were temporarily manipulated into sharing unverified AI-altered content, affecting diplomatic credibility but not disrupting core government functions.
- Economic security: Negligible. No significant economic systems, strategic industries, or technological competitive advantages were targeted or compromised.
- Societal stability: Substantial. The 'liar's dividend' created by synthetic imagery directly undermines international human rights verification, potentially accelerating state violence against political prisoners by eroding evidentiary standards.