In the summer of 2017, a Tesla sedan operating on Autopilot failed to maintain its lane, striking a curb in Redmond, Washington. The incident resulted in shredded tires and rear suspension damage to the vehicle. The driver, Microsoft AI researcher Eric Horvitz, was unharmed but used the incident to advocate for more robust safety reporting and ethical oversight in AI deployment.
A Tesla Sedan operating on Autopilot mode was not able to center itself on the road and drove over a yellow dividing curb in Redmond, Washington, causing minor damage to the vehicle’s rear suspension.
Risk classification
- Primary risk domain: 7 AI system safety, failures, & limitations
- Primary risk subdomain: 7.3 Lack of capability or robustness
The incident represents a physical failure of the Tesla Autopilot's lane-keeping capability, where the system failed to center the vehicle properly on a curving road, leading to a collision with a curb.
Additional risk subdomains
- 6.5 Governance failure: The report highlights a lack of regulatory reporting frameworks for AI safety incidents, comparing it to the lack of an FDA-like reporting system for autonomous vehicles.
Causal factors
- Entity: AI
- Intent: Unintentional
- Timing: Post-deployment
The incident was caused by the Tesla Autopilot system failing to properly center the vehicle post-deployment, which was an unintentional failure of the system's driving capabilities.
EU AI Act risk tier
High Risk: The system is used in critical infrastructure and transport (autonomous driving). The report describes a safety-critical system where failure can lead to physical accidents, stating 'Both driver's side tires of the vehicle nicked a raised yellow curb marking the center line, and shredded.'
AI system and alleged parties
- AI system: Autopilot (Tesla)
- AI purpose: Autonomous Driving; Navigation Assistant
- Behaviour type: Autonomous
- Alleged developer: Tesla
- Alleged deployer: Tesla
- Alleged harmed parties: Tesla drivers, Eric Horvitz
Harm severity
Severity ratings are based on this scale.
Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
- Physical: direct Negligible, indirect Negligible
- Infrastructure: direct Negligible, indirect Negligible
- Property: direct Negligible, indirect Negligible
- Financial: direct Negligible, indirect Negligible
- Environmental: direct Negligible, indirect Negligible
- Malicious content: direct Negligible, indirect Negligible
- Differential treatment: direct Negligible, indirect Negligible
- Civil rights: direct Negligible, indirect Negligible
- Democracy: direct Negligible, indirect Negligible
- Privacy: direct Negligible, indirect Negligible
- Psychological: direct Negligible, indirect Negligible
- Epistemic: direct Negligible, indirect Negligible
- Child sexual exploitation and abuse: direct Negligible, indirect Negligible
People affected
- Occurrences reported: 1
- People reportedly exposed: 1
Potential causes
Management
- Focus on Liability over Safety: Tesla prioritized establishing liability limits over resolving safety issues.
Technology
- Flawed Centering Algorithm: The Autopilot algorithm failed to center the vehicle properly on a curve.
- Inadequate Edge Case Handling: The system failed to handle a curving road with a raised yellow curb.
Data Inputs
- Inadequate Real-Time Data: Vehicle sensors failed to detect or correctly process the yellow curb.
Human Factors
- Driver Distraction: Driver was focused on a phone call about AI ethics instead of the road.
- Overreliance on Autopilot: Driver trusted the system to steer along a curving road without intervention.
Process and Methods
- Poor Feedback Mechanisms: Tesla lacked a formal system for users to report safety-critical AI bugs.
- Inadequate Risk Assessment: Deploying Autopilot on curving roads without robust safety guardrails.
Regulatory Environment
- Lack of AI Reporting Standards: No FDA-like federal reporting mandate existed for autonomous vehicle issues.
- Weak External Governance: Absence of national regulations or standards governing AI safety limits.
Information quality
- Classification confidence: High
- Reason for confidence: The primary incident is described consistently across two independent reports with specific details regarding the driver, location, vehicle behavior, and physical outcomes. The role of the AI system (Tesla Autopilot) is explicitly stated, and there are no conflicting accounts of the crash itself.
- Ambiguities identified: The reports do not specify the exact speed of the vehicle, though Tesla noted it was under 45 miles per hour, nor do they detail the exact technical reason why the lane-keeping algorithm failed to center the vehicle.
- Alternative interpretations: One could argue the incident was caused by human driver inattentiveness since Tesla Autopilot requires a fully attentive driver, but the physical failure of the lane-keeping algorithm itself is the clear technical trigger.
A minor 2017 traffic incident in Washington where a Tesla on Autopilot struck a curb, causing vehicle damage but no injuries. The event holds negligible national security implications and served primarily as a catalyst for advocacy on autonomous vehicle safety reporting standards.
- Overall national security impact: Negligible
- Scope: Single nation
- Primary target: No clear primary
- Alleged perpetrator: Unknown
Threat characteristics
- Imminence: Long-term. Past event from 2017 representing ongoing strategic discussions around autonomous vehicle safety standards rather than an active crisis.
- Autonomy: Human-supervised. Tesla Autopilot is designed as a driver-assist system requiring human supervision, which allowed the driver to quickly reclaim control.
- Novelty: Established threat. Lane-keeping and driver-assist calibration errors are established technical limitations of early autonomous driving systems.
Impact by dimension
- Physical security: Negligible. Minor traffic accident involving a single consumer vehicle with no casualties, kinetic threats, or critical infrastructure impact.
- Information security: Negligible. No intelligence compromise, disinformation, or information warfare elements were involved in this vehicle lane-keeping failure.
- Sovereignty: Negligible. Isolated driving incident with no impact on state authority, elections, border control, or core government operations.
- Economic security: Negligible. Incurred only minor private property damage to a single vehicle, with no strategic economic disruption or technology theft.
- Societal stability: Negligible. No implications for mass surveillance, human rights violations, or large-scale societal stability.