Google AI Overview Reportedly Misstates Aircraft Manufacturer as Airbus Instead of Boeing in Air India Flight 171 Crash

Following the fatal crash of Air India Flight 171, Google's AI Overview feature reportedly returned search results incorrectly identifying the aircraft involved as an Airbus A330 rather than the actual Boeing 787. The reported error, which varied across search queries, was traced to AI-generated summarizations that conflated references to Airbus as Boeing's competitor. Google later acknowledged and removed the faulty output.

Risk classification

• Primary risk domain: 3 Misinformation
• Primary risk subdomain: 3.1 False or misleading information

The AI system generated and spread incorrect factual information regarding a plane crash, leading to public misinformation.

Additional risk subdomains

• 7.3 Lack of capability or robustness: The system failed to perform reliably, hallucinating and conflating facts due to a lack of capability to understand truth.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The misinformation was generated by the AI system's non-deterministic hallucination post-deployment, which was an unintended outcome of its summarization goal.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The system is a search summarizer generating AI content, which falls under Limited Risk (Level 3) due to transparency obligations for AI-generated content.

AI system and alleged parties

• AI system: AI Overview (Google)
• AI purpose: Question Answering; Content Search
• Behaviour type: Assistant
• Alleged developer: Google
• Alleged deployer: Google
• Alleged harmed parties: General public, Airbus

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

People affected

• Occurrences reported: 1
• People reportedly exposed: 5

Potential causes

Management

• Rapid Expansion of Unstable Tech: Google steadily expanded AI Overviews despite known accuracy issues.
• Prioritization of Feature Rollout: Deploying AI features quickly over ensuring absolute factual accuracy.

Technology

• Non-deterministic Output: Generative AI produces different outputs even for identical inputs.
• Lack of Semantic Understanding: AI lacks the ability to understand what is factually true.
• Hallucination and Confabulation: System confidently generates plausible but false associations.

Data Inputs

• Co-occurrence of Competitor Names: News articles mentioning competitor Airbus misled the model.

Human Factors

• User Trust in Confident Output: Users overlook disclaimers when the AI presents answers confidently.
• Low Prominence of Disclaimers: Users gloss over warnings placed inconspicuously at the bottom.

Process and Methods

• Reactive Manual Removal: Google relies on manual deletion after errors are publicly reported.
• Inadequate Validation of Summaries: No automated verification of factual claims before displaying them.

Regulatory Environment

• Absence of Generative AI Standards: Lack of industry standards for search engine AI accuracy.

Information quality

• Classification confidence: High
• Reason for confidence: The report clearly details the AI system involved, the specific error made, the likely technical cause of the hallucination, and the developer's response. There is very little ambiguity regarding the sequence of events.
• Ambiguities identified: None of significance.
• Alternative interpretations: None.

Google's AI Overview generated a factual error by misidentifying a Boeing aircraft as an Airbus model in a fatal crash summary. The incident represents a minor, unintentional AI hallucination in a public consumer tool with negligible national security implications, and was promptly corrected by human intervention.

• Overall national security impact: Negligible
• Scope: Multiple nations
• Primary target: No clear primary
• Other affected: India, United States, France
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. The specific erroneous search response has been manually removed, leaving only long-term systemic concerns about AI reliability.
• Autonomy: Human-supervised. The AI system generated the summary autonomously, but human intervention was required and exercised to correct the error.
• Novelty: Established threat. Large language model hallucinations and factual errors in search summarization are well-established and common phenomena.

Impact by dimension

• Physical security: Negligible. The incident involves a search engine hallucination regarding a past aviation accident and poses no physical threat to infrastructure or human safety.
• Information security: Negligible. The misinformation was an unintentional, non-deterministic AI hallucination in a consumer search tool, not a coordinated information warfare campaign.
• Sovereignty: Negligible. The incident has no impact on state authority, government decision-making, or constitutional processes.
• Economic security: Negligible. While involving major aviation companies Boeing and Airbus, the temporary search error does not threaten strategic industries or economic security.
• Societal stability: Negligible. The epistemic harm was limited to a minor factual error about an aircraft manufacturer, causing no threat to social cohesion or human rights.