Purportedly AI-Generated Image Prompted Emergency Investigation of False Fire at South Africa's Orlando West High School

A purportedly AI-generated image reportedly depicting Orlando West High School of Soweto, South Africa, on fire circulated and was allegedly shared with emergency services. Johannesburg EMS reportedly investigated and visited the school, confirming that no fire had occurred. Officials said the false report caused public alarm and diverted emergency resources.

Risk classification

• Primary risk domain: 3 Misinformation
• Primary risk subdomain: 3.1 False or misleading information

The incident involved the creation and dissemination of a fabricated AI-generated image of a school on fire, which misled emergency services and the public.

Additional risk subdomains

• 4.3 Fraud, scams, and targeted manipulation: The youngster used the AI-generated image to conduct a targeted hoax/prank, manipulating emergency services into believing a real emergency was occurring.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The incident was caused by a human youngster who intentionally generated and shared a fake image of a school on fire as a prank after the AI model had been deployed.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Risk Level 3: Limited Risk. The system generated synthetic media (a deepfake image of a school on fire), which falls under transparency obligations for AI-generated content.

AI system and alleged parties

• AI purpose: Deepfake Image Generation; Image Generation
• Behaviour type: Tool
• Alleged developer: Synthetic media generation technology developers, Synthetic image generation technology developers
• Alleged deployer: Minors, Information manipulation actors in South Africa, Information manipulation actors
• Alleged harmed parties: Orlando West High School, General public of South Africa, General public, Epistemic integrity, Emergency responders, Educational communities, City of Johannesburg Emergency Management Services

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Minor
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Minor
• Epistemic: direct Negligible, indirect Minor
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Malicious content

Reported: The report explicitly describes malicious content in the form of a fabricated emergency-related image.

Directly caused: A youngster generated a fake image of Orlando West High School engulfed in flames.

Indirectly caused: The fabricated image was shared and circulated on social media and sent to emergency services, spreading false emergency information.

Psychological

Reported: The report explicitly describes psychological distress in the form of widespread alarm and panic caused by the incident.

Indirectly caused: The circulation of the fake image of the school on fire caused widespread alarm and unnecessary panic among the local community in Orlando.

Epistemic

Reported: The report explicitly describes epistemic harm through the spread of false emergency-related content and misinformation.

Directly caused: The creation of a fabricated image showing a school on fire.

Indirectly caused: The image misled a local radio station and emergency services, requiring an active investigation to verify the truth.

People affected

• Occurrences reported: 1
• People reportedly exposed: 100

Potential causes

Technology

• AI Image Generation: AI tools enabled the creation of a highly realistic fake fire image.

Human Factors

• Irresponsible Pranking: A youngster deliberately shared the fake image to deceive emergency services.

Process and Methods

• Manual Verification Process: EMS had to physically dispatch and investigate to verify the fire.

Regulatory Environment

• Insufficient Legal Consequences: Weak legal deterrents failed to prevent sharing AI-generated fake emergencies.

Information quality

• Classification confidence: High
• Reason for confidence: The reports clearly describe the incident, the nature of the AI-generated image, the entity responsible (a youngster), and the consequences (EMS investigation, wasted resources, community panic). There is little ambiguity about what transpired.
• Ambiguities identified: The specific AI tool used to generate the image is not named.

An individual used generative AI to create a fake image of a school on fire in Soweto, South Africa, causing localized community panic and diverting emergency services. The incident constitutes a minor national security concern, highlighting the potential for AI-generated hoaxes to temporarily disrupt local public safety resources.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: South Africa
• Alleged perpetrator: Individual

Threat characteristics

• Imminence: Long-term. The incident is a resolved local event representing an ongoing strategic concern regarding AI-enabled hoaxes rather than an active crisis.
• Autonomy: Human-controlled. The AI functioned purely as a tool, generating the synthetic image based on direct prompts from the user without autonomous decision-making.
• Novelty: Established threat. Emergency hoaxes and fabricated images are well-established threats, even though generative AI simplifies the creation process.

Impact by dimension

• Physical security: Minor. Minor impact as the hoax diverted critical emergency services resources, though it did not result in physical damage, kinetic threat, or casualties.
• Information security: Negligible. No state-sponsored information warfare, intelligence compromise, or systematic disinformation operations were indicated.
• Sovereignty: Minor. Minor disruption to local government functions as Johannesburg Emergency Management Services had to investigate the false alarm.
• Economic security: Negligible. Negligible economic impact, restricted to minor operational and fuel costs for local emergency response vehicles.
• Societal stability: Minor. Generated temporary community panic and widespread alarm within Soweto, but did not threaten broader social cohesion or human rights.