Air Canada was ordered by a civil tribunal to pay damages to a customer after its AI chatbot provided incorrect information regarding bereavement fare refund policies. The chatbot falsely informed the customer that they could book a full-price ticket and claim a retroactive discount within 90 days, which contradicted the airline's actual policy. Air Canada unsuccessfully argued that the chatbot was a separate legal entity, but the tribunal ruled the airline responsible for the information provided by its automated systems.
A Canadian small claims tribunal reportedly ordered Air Canada to pay $812.02 in damages and court fees after its website chatbot allegedly provided inaccurate information about bereavement fare eligibility, leading a customer to overpay for flights. The tribunal reportedly found the airline responsible for information presented by its chatbot, rejecting the argument that the chatbot was a separate legal entity, and characterized the error as negligent misrepresentation.
Risk classification
- Primary risk domain: 3 Misinformation
- Primary risk subdomain: 3.1 False or misleading information
The chatbot generated false and misleading information regarding the airline's bereavement policy, which led the user to make an inaccurate financial decision.
Additional risk subdomains
- 7.3 Lack of capability or robustness: The chatbot exhibited a technical failure by hallucinating incorrect policy details that contradicted the static website content.
Causal factors
- Entity: AI
- Intent: Unintentional
- Timing: Post-deployment
The financial harm was caused by the AI chatbot generating incorrect policy information after it was deployed on Air Canada's website.
EU AI Act risk tier
- Risk tier: 3 Limited Risk
Limited Risk: The system is a customer service chatbot, which falls under the Limited Risk category requiring transparency obligations so users know they are interacting with an AI.
AI system and alleged parties
- AI system: Air Canada chatbot
- AI purpose: Chatbot; Question Answering
- Behaviour type: Assistant
- Alleged developer: Air Canada
- Alleged deployer: Air Canada
- Alleged harmed parties: Jake Moffatt
Harm severity
Severity ratings are based on this scale.
Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
- Physical: direct Negligible, indirect Negligible
- Infrastructure: direct Negligible, indirect Negligible
- Property: direct Negligible, indirect Negligible
- Financial: direct Negligible, indirect Negligible
- Environmental: direct Negligible, indirect Negligible
- Malicious content: direct Negligible, indirect Negligible
- Differential treatment: direct Negligible, indirect Negligible
- Civil rights: direct Negligible, indirect Negligible
- Democracy: direct Negligible, indirect Negligible
- Privacy: direct Negligible, indirect Negligible
- Psychological: direct Negligible, indirect Negligible
- Epistemic: direct Negligible, indirect Negligible
- Child sexual exploitation and abuse: direct Negligible, indirect Negligible
People affected
- Occurrences reported: 1
- People reportedly harmed: 1
- People reportedly exposed: 1
Potential causes
Management
- Prioritizing Automation Over Care: Management rushed AI deployment to lower expenses before ensuring reliability.
- Flawed Legal Defense Strategy: Management tried to disclaim liability by calling the AI a separate entity.
- Inadequate Risk Assessment: Failed to assess financial and reputational risks of chatbot hallucinations.
Technology
- AI Chatbot Hallucination: The LLM-based chatbot fabricated retroactive bereavement refund rules.
- Lack of Chatbot Guardrails: No technical safeguards to prevent outputting inaccurate policy information.
- System Integration Failure: Chatbot was not synced with the actual static website policy database.
Data Inputs
- Conflicting Policy Sources: Inconsistent data between the chatbot knowledge base and the static web page.
- Lack of Input/Output Verification: No validation mechanism for the data retrieved and generated by the chatbot.
Human Factors
- Reasonable Customer Reliance: The passenger trusted the chatbot as an official and accurate website source.
- Inadequate Human Oversight: No human-in-the-loop system to verify the chatbot's policy advice.
Process and Methods
- Lack of Accuracy Warnings: The interface failed to warn users that chatbot outputs might be inaccurate.
- Inadequate Testing Processes: The chatbot was deployed as an experiment without rigorous accuracy testing.
- Flawed Dispute Resolution: Customer service initially refused to honor the chatbot's promise.
Regulatory Environment
- Absence of AI Regulations: No legal frameworks exist to govern AI chatbot accuracy in travel.
- Weak Passenger Protections: Weak local passenger regulations allowed the airline to resist the refund.
Information quality
- Classification confidence: High
- Reason for confidence: The incident is thoroughly documented across multiple reputable news sources detailing the specific facts, court rulings, and financial figures.
An Air Canada customer service chatbot hallucinated a bereavement refund policy, leading to a minor civil tribunal ruling against the airline. This is a commercial contract dispute with negligible national security implications, though it establishes a notable legal precedent regarding corporate liability for AI-generated misinformation.
- Overall national security impact: Negligible
- Scope: Single nation
- Primary target: Canada
- Alleged perpetrator: Unknown
Threat characteristics
- Imminence: Long-term. This is a resolved legal case concerning a minor commercial dispute, presenting no active or near-term national security crisis.
- Autonomy: Human-supervised. The chatbot operated autonomously to generate and deliver policy information directly to the customer, though within a corporate-controlled website.
- Novelty: Evolved capability. While LLM hallucinations are common, this incident represents an evolved legal precedent establishing corporate liability for autonomous AI outputs.
Impact by dimension
- Physical security: Negligible. The incident involves a customer service chatbot error with no impact on physical infrastructure, transportation safety, or kinetic systems.
- Information security: Negligible. No indication of information warfare, state-sponsored disinformation, or compromise of classified intelligence.
- Sovereignty: Negligible. The incident was resolved through standard civil tribunal processes, posing no threat to government operations or state sovereignty.
- Economic security: Negligible. The financial impact is limited to a minor civil dispute under 1,000 CAD, presenting no threat to macroeconomic stability or strategic technology.
- Societal stability: Negligible. The incident is a localized consumer dispute with no systemic implications for civil liberties, societal stability, or human rights.