Glovo Driver in Italy Fired via Automated Email after Being Killed in Accident

Delivery company Glovo's automated system sent an email terminating an employee for "non-compliance terms and conditions" after the employee was killed in a car accident while making a delivery on Glovo's behalf.

Risk classification

• Primary risk domain: 5 Human-Computer Interaction
• Primary risk subdomain: 5.2 Loss of human agency and autonomy

The AI system automatically terminated the driver's employment without human review, representing a complete delegation of critical decision-making authority to an algorithm.

Additional risk subdomains

• 6.2 Increased inequality and decline in employment quality: The algorithmic management system pressured drivers to deliver faster to maintain high ratings, leading to dangerous working conditions and a fatal accident.
• 7.3 Lack of capability or robustness: The automated system failed to distinguish between a routine account suspension and a driver's death, mistakenly sending a firing email to the family.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The automated firing email was an unintended outcome of the AI system's account suspension protocol, and the algorithmic pressure contributing to the accident was an unintentional risk of the system's optimization goals.

EU AI Act risk tier

• Risk tier: 2 High Risk

Risk Level 2: High Risk. The system is an employment and worker management system used to monitor, evaluate, and terminate couriers, which falls under the High Risk category of the EU AI Act.

AI system and alleged parties

• AI system: Glovo delivery platform algorithm
• AI purpose: Workforce Administration; Workforce Monitoring and Evaluation
• Behaviour type: Autonomous
• Alleged developer: Glovo
• Alleged deployer: Glovo
• Alleged harmed parties: Sebastian Galassi's family, Sebastian Galassi

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Substantial
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Minor
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Minor, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Physical

Reported: Yes, the report explicitly describes a fatality.

Indirectly caused: Sebastian Galassi, a 26-year-old rider, died in a traffic accident. The union and critics attribute this indirectly to the algorithmic pressure of the Glovo platform.

Inferred additional harm: The report mentions three other delivery drivers (Gennaro, Romulo, and another Sebastian) who died in similar work-related accidents in the region.

Civil rights

Reported: Yes, labor rights and working conditions were violated.

Indirectly caused: The algorithmic management system violated basic labor rights by enforcing extreme piecework pressure and terminating employment automatically without due process.

Inferred additional harm: Widespread erosion of workers' rights across the gig economy due to algorithmic management.

Psychological

Reported: Yes, the family experienced distress upon receiving the automated firing email.

Directly caused: The automated email sent to the deceased driver's family stating he was fired for non-compliance caused emotional distress and outrage.

Inferred additional harm: Other riders and their families likely experience anxiety and stress due to the constant pressure of the algorithmic rating system.

People affected

• Occurrences reported: 1
• People reportedly harmed: 1
• People reportedly exposed: 1

Potential causes

Management

• Prioritizing Speed Over Safety: Company competition model focused heavily on rapid delivery times.
• Inadequate Algorithmic Safeguards: Management failed to implement ethical checkpoints in automated systems.

Technology

• Automated Termination Algorithm: System automatically fired driver for missed deliveries without human review.
• Poor System Integration: Identity suspension triggered automated termination email by mistake.

Data Inputs

• Lack of Real-Time Incident Data: Algorithm lacked data about the driver fatal accident before actioning.
• Inaccurate Account Status Signals: System interpreted inactivity from the accident as policy non-compliance.

Human Factors

• Pressure to Speed: Riders forced to rush and take risks to meet delivery times and earn more.

Process and Methods

• Automated Email Dispatched: No manual verification before sending automated termination emails to riders.
• Piecework Pay System: Pay-per-delivery model encourages dangerous driving to maximize income.

Regulatory Environment

• Lack of Gig Worker Protections: Absence of regulations ensuring hourly pay and worker safety guarantees.
• Unenforced Court Rulings: Failure to implement existing court rulings on proper rider classification.

Information quality

• Classification confidence: High
• Reason for confidence: The reports provide consistent and clear accounts of the incident from multiple sources, including statements from the family, the company, union representatives, and local authorities. The role of the automated system in sending the email is explicitly acknowledged by Glovo.
• Ambiguities identified: The exact technical logic of the algorithm's deactivation trigger and how it interacts with manual account suspensions is slightly unclear, as Glovo claimed the email was a mistake sent during a manual suspension.
• Alternative interpretations: The accident itself could be viewed purely as a traffic incident rather than an AI safety incident, though the algorithmic pressure is heavily cited as a contributing factor.

A fatal accident involving a Glovo delivery driver in Italy triggered an automated termination email to his family, leading to localized strikes and protests. The incident highlights domestic labor and regulatory challenges surrounding algorithmic management, but presents minor to negligible national security implications.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: Italy
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. Represents an ongoing regulatory and labor policy debate regarding algorithmic management rather than an immediate national security crisis.
• Autonomy: Full autonomy. The algorithmic system automatically terminated the driver's account and dispatched the email without human oversight or intervention.
• Novelty: Established threat. Algorithmic management pressure and automated HR actions are well-documented issues in the gig economy.

Impact by dimension

• Physical security: Negligible. The incident involves a localized traffic accident and does not pose a threat to critical infrastructure, kinetic systems, or national physical security.
• Information security: Negligible. No intelligence capabilities, classified models, or systematic disinformation campaigns were involved in this incident.
• Sovereignty: Negligible. Core government operations and state authority remain unaffected, with local judiciary and municipal authorities responding normally.
• Economic security: Negligible. The economic impact is limited to local gig-economy disruptions and strikes in Florence, posing no threat to national economic stability or strategic industries.
• Societal stability: Minor. The incident sparked localized civil unrest, labor strikes, and public debate over gig-worker rights, which are manageable within standard domestic political and legal frameworks.