On April 6, 2022, a TuSimple autonomous truck veered into a concrete freeway divider in Tucson, Arizona. An internal report attributed the crash to the system executing a 2.5-minute-old command that should have been cleared. While TuSimple blamed human error, researchers argued that the autonomous system lacked necessary safety safeguards to prevent such a maneuver. The incident triggered a federal safety compliance investigation by the FMCSA and NHTSA.
A TuSimple autonomous truck operating with backup drivers behind the wheel operated on an outdated command sequence and suddenly veered into the center divide on the interstate freeway.
Risk classification
- Primary risk domain: 7 AI system safety, failures, & limitations
- Primary risk subdomain: 7.3 Lack of capability or robustness
The system failed to operate robustly under real-world conditions, executing an outdated command and lacking basic safety safeguards to prevent dangerous high-speed maneuvers.
Additional risk subdomains
- 6.4 Competitive dynamics: The company rushed testing on public roads and bypassed safety standards due to intense market pressure to deliver driverless trucks to investors.
Causal factors
- Entity: AI
- Intent: Unintentional
- Timing: Post-deployment
The crash was caused by the autonomous driving system executing an outdated command and steering the truck into a barricade post-deployment.
EU AI Act risk tier
High Risk: The system is an AI used in critical infrastructure and transport (autonomous trucking on public highways), which has significant implications for public safety. The report describes an 'autonomous driving system' operating a semi-trailer truck on public roads.
AI system and alleged parties
- AI system: autonomous driving system (TuSimple)
- AI purpose: Autonomous Driving; Navigation Assistant
- Behaviour type: Autonomous
- Alleged developer: TuSimple
- Alleged deployer: TuSimple
- Alleged harmed parties: TuSimple, State of Arizona
Harm severity
Severity ratings are based on this scale.
Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
- Physical: direct Negligible, indirect Negligible
- Infrastructure: direct Negligible, indirect Negligible
- Property: direct Minor, indirect Negligible
- Financial: direct Minor, indirect Negligible
- Environmental: direct Negligible, indirect Negligible
- Malicious content: direct Negligible, indirect Negligible
- Differential treatment: direct Negligible, indirect Negligible
- Civil rights: direct Negligible, indirect Negligible
- Democracy: direct Negligible, indirect Negligible
- Privacy: direct Negligible, indirect Negligible
- Psychological: direct Negligible, indirect Negligible
- Epistemic: direct Negligible, indirect Negligible
- Child sexual exploitation and abuse: direct Negligible, indirect Negligible
Property
Reported: The report describes the truck slamming into a concrete barricade, though TuSimple claimed no property was damaged.
Directly caused: The TuSimple autonomous semi-trailer truck sustained physical damage from slamming into the concrete barricade.
Financial
Reported: The report mentions TuSimple's stock price falling down more than 86% from its peak, though direct crash costs are not specified.
Directly caused: The direct financial loss includes the cost of repairing or replacing the damaged autonomous truck, which is not quantified in the reports.
Inferred additional harm: Significant financial losses likely resulted from the subsequent federal safety compliance investigation, delayed commercialization timelines, and reputational damage affecting stock value.
People affected
- Occurrences reported: 1
- People reportedly exposed: 2
Potential causes
Management
- Prioritizing Market Speed Over Safety: Investor pressure incentivized rapid testing at the expense of public safety.
- Suppression of Safety Concerns: Employees raising safety concerns were ignored or terminated by the CEO.
- Bypassing Safety Standards: The founder tested ideas on public roads while bypassing safety regulations.
Technology
- Execution of Outdated Commands: The system executed a 2.5-minute-old left-turn command instead of erasing it.
- Lack of Engagement Safeguards: The system allowed engagement even when the computer was not fully initialized.
- No High-Speed Turn Limits: The system permitted a sharp turn while the truck was traveling at 65 mph.
Data Inputs
- Stale Control Data: A left-turn command from 2.5 minutes prior remained in the queue.
Human Factors
- Improper System Reboot: The operator failed to properly reboot the system before engaging it.
- Attempted Engagement of Failed ADS: The driver tried to engage the system when the computer was not initialized.
- Disregarded Driver Concerns: Management dismissed safety drivers' flags about steering override failures.
Process and Methods
- Inadequate Software Testing: Lack of regular software vulnerability checks and secure communication.
- Bypassing Security Teams: The driverless test was launched without informing internal security teams.
- Insufficient Practice Runs: Launched driverless test with less than half of the 500 targeted practice runs.
Regulatory Environment
- Lack of Pre-market Safety Oversight: No regulatory block prevented testing highly unsafe systems on public roads.
Information quality
- Classification confidence: High
- Reason for confidence: The reports provide consistent, detailed accounts of the crash from multiple sources, including internal company documents, regulatory filings, and independent researchers. The technical cause (executing an outdated command due to initialization failure) and the lack of safety safeguards are clearly explained.
- Ambiguities identified: There is a slight conflict between TuSimple's claim of 'no property damage' and the fact that the truck slammed into a concrete barricade, which likely caused damage to both the truck and the barricade.
- Alternative interpretations: TuSimple framed the incident purely as 'human error' due to improper rebooting, whereas researchers and former employees interpreted it as a fundamental system safety failure.
A TuSimple autonomous truck crashed into a concrete highway barrier in Arizona due to executing an outdated command. The incident represents a minor physical security concern handled by standard transportation safety regulators (FMCSA and NHTSA) with negligible implications for broader national security.
- Overall national security impact: Minor
- Scope: Single nation
- Primary target: United States
- Alleged perpetrator: Unknown
Threat characteristics
- Imminence: Long-term. Represents a long-term regulatory and technological safety concern for autonomous vehicle deployment rather than an active national security crisis.
- Autonomy: Human-supervised. The truck operated autonomously during the event, though human safety operators were present in the cab to supervise.
- Novelty: Established threat. Autonomous vehicle crashes and software execution failures on public roads are established risks with prior precedents.
Impact by dimension
- Physical security: Minor. An autonomous semi-trailer truck veered across a highway and struck a concrete divider. While this involved physical damage to road infrastructure, there were no injuries and the hazard remains manageable within standard civil transportation safety procedures.
- Information security: Negligible. No information warfare, intelligence compromise, or systematic information manipulation was associated with this commercial vehicle accident.
- Sovereignty: Negligible. The incident was a localized commercial testing accident and posed no threat to state authority, government decision-making, or constitutional processes.
- Economic security: Negligible. While the incident led to stock decline for the developer, it did not involve strategic technology theft, foreign adversary action, or systemic threats to national economic stability.
- Societal stability: Negligible. The incident did not involve mass surveillance, algorithmic oppression, or threats to civil liberties and societal cohesion.