Employee Automatically Terminated by Computer Program

A software developer was erroneously fired by his company's automated personnel management system after his manager failed to renew his contract during a corporate transition. The system automatically revoked his building access, system logins, and payroll status, and the process proved irreversible despite intervention from his direct manager and director. The developer was eventually reinstated after three weeks of lost pay, but he subsequently resigned due to the professional stigma caused by the incident.

An employee was laid off, allegedly by an artificially intelligent personnel system, and blocked from access to the building and computer systems without their knowledge.

Source: AI Incident Database

Risk classification

  • Primary risk domain: 5 Human-Computer Interaction
  • Primary risk subdomain: 5.2 Loss of human agency and autonomy

The automated system made irreversible decisions to terminate the employee's access and employment, leaving human managers and directors completely powerless to override or stop the process.

Additional risk subdomains

  • 7.3 Lack of capability or robustness: The system failed to perform reliably under exception conditions, specifically failing to allow human override when an error occurred.

Causal factors

  • Entity: AI
  • Intent: Unintentional
  • Timing: Post-deployment

The incident was caused by an automated HR system executing an unintended termination sequence due to a missing contract renewal input.

EU AI Act risk tier

  • Risk tier: 2 High Risk

High Risk: The system is an employment and worker management system used to manage employee termination and access, which has significant implications for safety, fundamental rights, and worker management.

AI system and alleged parties

  • AI system: automated personnel system
  • AI purpose: Workforce Administration
  • Behaviour type: Autonomous
  • Alleged developer: unknown
  • Alleged deployer: unknown
  • Alleged harmed parties: Ibrahim Diallo

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

  • Physical: direct Negligible, indirect Negligible
  • Infrastructure: direct Negligible, indirect Negligible
  • Property: direct Negligible, indirect Negligible
  • Financial: direct Negligible, indirect Negligible
  • Environmental: direct Negligible, indirect Negligible
  • Malicious content: direct Negligible, indirect Negligible
  • Differential treatment: direct Negligible, indirect Negligible
  • Civil rights: direct Negligible, indirect Negligible
  • Democracy: direct Negligible, indirect Negligible
  • Privacy: direct Negligible, indirect Negligible
  • Psychological: direct Minor, indirect Minor
  • Epistemic: direct Negligible, indirect Negligible
  • Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Psychological

Reported: The report explicitly describes psychological distress and social isolation experienced by the employee.

Directly caused: The employee experienced embarrassment and distress from being escorted out of the building by security guards and having his co-workers become distant and suspicious.

Indirectly caused: The stress and stigma of the automated firing led the employee to resign from his position.

People affected

  • Occurrences reported: 1
  • People reportedly harmed: 1
  • People reportedly exposed: 1

Potential causes

Management

  • Lack of System Accountability: Management failed to retain control and oversight over HR tools.
  • Poor Risk Assessment: Management did not assess risks of fully automating HR terminations.

Technology

  • Irreversible Automated Workflows: System lacked a mechanism to halt or reverse the termination chain.
  • Lack of Human Override: No 'red button' existed for managers to stop the automated process.
  • Dumb Automation Architecture: System had no fuzzy logic or intelligence to flag anomalies before firing.

Data Inputs

  • Missing Contract Renewal Data: The system treated an unrenewed contract as an active termination trigger.
  • Flagged Keycard Scan: Attempted use of deactivated card triggered automated threat emails.

Human Factors

  • Manager Negligence: Former manager failed to renew Diallo's contract during transition.
  • Overreliance on Automation: Humans assumed the system's outputs were correct without verification.

Process and Methods

  • Inadequate Transition Processes: Acquisition transition lacked checks to ensure contract continuity.
  • Flawed Security Protocols: Automated threat emails sent to security without human verification.
  • Lack of System Safeguards: No process existed to verify termination decisions with current managers.

Information quality

  • Classification confidence: High
  • Reason for confidence: The reports are highly consistent and based directly on the first-hand viral blog post written by the affected individual, Ibrahim Diallo. The sequence of events, the cause, and the outcomes are clearly documented across multiple reputable sources.
  • Ambiguities identified: The exact technical architecture of the automated system (whether it is a simple script database or a more complex algorithmic HR platform) is not fully detailed.
  • Alternative interpretations: The incident could be viewed as a pure database/software workflow failure rather than an AI failure, but the autonomous decision-making and lack of human override align it with AI safety and automation risks.

An automated corporate HR system erroneously terminated a software developer and locked him out of physical and digital assets due to a database error. While demonstrating the risks of full system autonomy and lack of human override in private enterprise, the incident has negligible national security implications.

  • Overall national security impact: Negligible
  • Scope: Single nation
  • Primary target: No clear primary
  • Alleged perpetrator: Unknown

Threat characteristics

  • Imminence: Long-term. The incident represents a localized corporate automation error with no ongoing or imminent threat to national security.
  • Autonomy: Full autonomy. The automated HR system executed the termination sequence, revoked credentials, and barred access autonomously without allowing human managers to override the process.
  • Novelty: Evolved capability. Represents an evolution in automated workforce management where interconnected systems act autonomously across physical and digital domains without manual overrides.

Impact by dimension

  • Physical security: Negligible. The incident involves a corporate HR and personnel management system failure with no impact on physical security, critical infrastructure, or kinetic systems.
  • Information security: Negligible. No intelligence assets, classified models, or information operations were involved in this corporate automation error.
  • Sovereignty: Negligible. This was a private sector corporate incident with no impact on government operations, elections, or state sovereignty.
  • Economic security: Negligible. The economic impact was localized to a single employee's temporary loss of salary and minor corporate administrative overhead, presenting no national economic threat.
  • Societal stability: Negligible. While the incident caused personal distress and temporary financial harm to one individual, it did not threaten societal stability or scale to systemic human rights violations.
Explore in the interactive Incident Tracker