Purportedly AI-Generated Image Reportedly Misled Daejeon Authorities Searching for Escaped Wolf Neukgu

A 40-year-old man used ChatGPT to generate a fake image of an escaped wolf named Neukgu, which he then shared in a group chat. The image was mistakenly used by Daejeon authorities in official alerts and press briefings, leading to a diversion of search resources. The man is now under investigation for disrupting government work by deception.

South Korean police alleged that a 40-year-old man used ChatGPT's image-generation capabilities to add escaped wolf Neukgu to a Daejeon street photo, then posted the purportedly fabricated image in a company group chat. Authorities reportedly used the image in alerts and briefings, redirecting search resources and disrupting public-safety operations before police identified him through CCTV and AI-use records.

Source: AI Incident Database

Risk classification

  • Primary risk domain: 3 Misinformation
  • Primary risk subdomain: 3.1 False or misleading information

The incident involved the generation of a fake image that misled both the public and government authorities, leading to inaccurate beliefs and the diversion of public safety resources.

Additional risk subdomains

  • 5.1 Overreliance and unsafe use: Government authorities over-relied on the unverified AI-generated image, using it to redirect search operations and issue official emergency alerts without verifying its authenticity.

Causal factors

  • Entity: Human
  • Intent: Unintentional
  • Timing: Post-deployment

The incident was caused by a human decision to generate and share a fake image. The disruption of government work was an unintentional consequence of the user's action, which he claimed was done 'for fun'.

EU AI Act risk tier

  • Risk tier: 3 Limited Risk

Limited Risk: The system is a general-purpose AI used to generate synthetic content (an AI-generated image), which falls under transparency obligations for AI-generated content and deepfakes.

AI system and alleged parties

  • AI system: ChatGPT (OpenAI)
  • AI purpose: Deepfake Image Generation; Social Media Content Generation
  • Behaviour type: Tool
  • Alleged developer: OpenAI
  • Alleged deployer: Unnamed 40-year-old man arrested by Daejeon police
  • Alleged harmed parties: Neukgu, General public of South Korea, General public of Daejeon, General public, Epistemic integrity, Emergency services, Daejeon Metropolitan Police Agency, Daejeon Metropolitan City, Daejeon Fire Headquarters

Harm severity

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

  • Physical: direct Negligible, indirect Negligible
  • Infrastructure: direct Negligible, indirect Negligible
  • Property: direct Negligible, indirect Negligible
  • Financial: direct Negligible, indirect Negligible
  • Environmental: direct Negligible, indirect Negligible
  • Malicious content: direct Negligible, indirect Negligible
  • Differential treatment: direct Negligible, indirect Negligible
  • Civil rights: direct Negligible, indirect Negligible
  • Democracy: direct Negligible, indirect Negligible
  • Privacy: direct Negligible, indirect Negligible
  • Psychological: direct Negligible, indirect Negligible
  • Epistemic: direct Minor, indirect Minor
  • Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Epistemic

Reported: The report explicitly describes epistemic harm where an AI-generated image misled authorities and the public about the location of an escaped wolf.

Directly caused: The AI-generated image of the wolf at an intersection directly misled the authorities and the public, corrupting the information environment during an active public safety event.

Indirectly caused: The city government issued an emergency text warning residents based on the fake image, and presented it at a press briefing, spreading the misinformation further.

Inferred additional harm: N/A

People affected

  • Occurrences reported: 1
  • People reportedly exposed: 1500000

Potential causes

Management

  • Poor Crisis Information Management: Failure to establish clear verification steps before acting on tips.

Technology

  • Realistic AI Generation: Software enabled creation of highly realistic fake image of the wolf.
  • Accessible AI Tools: Easy access to AI tools allowed rapid creation of misleading content.

Data Inputs

  • Lack of Synthetic Metadata: No digital metadata or watermarks identified the image as AI-generated.

Human Factors

  • Malicious or Careless Creation: Individual created and shared the fake image 'for fun' without caution.
  • Cognitive Bias of Authorities: Search teams rushed to believe the realistic image without verification.

Process and Methods

  • Inadequate Source Verification: No system in place to verify the origin of images found online.
  • Flawed Emergency Alert Protocol: City issued emergency texts based on unverified social media images.

Regulatory Environment

  • Weak AI Safety Regulations: Lack of strict rules preventing the misuse of generative AI tools.

Information quality

  • Classification confidence: High
  • Reason for confidence: The report provides clear, consistent details about the incident, including the AI system used, the actions of the suspect, the reaction of the authorities, and the legal consequences. There are no major contradictions.
  • Ambiguities identified: The report does not specify whether the suspect intentionally sent the photo to authorities or if they found it after he shared it online.

An individual used ChatGPT to generate a fake image of an escaped wolf, which municipal authorities in South Korea mistakenly used to redirect search operations and issue public emergency alerts. While the incident caused localized operational disruption and public concern, it represents a minor national security impact, highlighting vulnerabilities in government verification of AI-generated media.

  • Overall national security impact: Minor
  • Response level: Moderate
  • Scope: Single nation
  • Primary target: South Korea
  • Alleged perpetrator: Individual

Threat characteristics

  • Imminence: Long-term. The immediate incident is resolved, but it highlights an ongoing strategic vulnerability regarding the verification of digital media by public safety authorities.
  • Autonomy: Human-controlled. The AI system acted purely as a tool, generating the image based on direct prompts from the human user without any autonomous decision-making.
  • Novelty: Evolved capability. While deepfakes are established, this represents an evolved threat where consumer-grade generative AI is easily leveraged to disrupt real-world municipal emergency response operations.

Impact by dimension

  • Physical security: Minor. The incident caused the temporary redirection of search resources for an escaped wolf but did not result in physical harm, kinetic attacks, or critical infrastructure damage.
  • Information security: Minor. An AI-generated image was used to spread localized misinformation, fooling local authorities. However, this was an isolated prank rather than a coordinated state-sponsored information warfare campaign.
  • Sovereignty: Minor. The fake image disrupted municipal government operations, leading authorities to issue a false emergency alert and redirect search assets, but it did not threaten national sovereignty or core constitutional processes.
  • Economic security: Negligible. The incident caused minor, unquantified operational costs due to diverted search efforts, presenting negligible threat to national economic or technological security.
  • Societal stability: Minor. An emergency text alert was sent to approximately 1.5 million residents based on the fake image, causing localized public concern but no widespread civil unrest or systemic human rights violations.
Explore in the interactive Incident Tracker