Waymo Self-Driving Taxi Reportedly Behaved Unexpectedly, Driving away from Support Crew

A Waymo self-driving taxi car was reportedly shown on video stranded on a road in Arizona while carrying a passenger, suddenly driving away from the company's roadside assistance worker, and ended up being stuck farther down the road.

Risk classification

• Primary risk domain: 7 AI system safety, failures, & limitations
• Primary risk subdomain: 7.3 Lack of capability or robustness

The Waymo vehicle failed to perform reliably when encountering unexpected road conditions (traffic cones) and exhibited erratic behavior, demonstrating a lack of capability and robustness in dynamic environments.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The incident was caused by the autonomous vehicle's inability to navigate construction cones and its unexpected behavior of driving away from roadside assistance.

EU AI Act risk tier

• Risk tier: 2 High Risk

Risk Level 2. High Risk: The Waymo self-driving taxi operates as an autonomous vehicle in public traffic, which represents an AI system in critical infrastructure and transport safety, having significant implications for public safety.

AI system and alleged parties

• AI system: Waymo Driver (Waymo)
• AI purpose: Autonomous Driving; Navigation Assistant
• Behaviour type: Autonomous
• Alleged developer: Waymo
• Alleged deployer: Waymo
• Alleged harmed parties: Waymo passengers

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

People affected

• Occurrences reported: 1
• People reportedly exposed: 5

Potential causes

Management

• Operational Process Gaps: Management failed to define clear protocols for remote-to-ground handoffs.

Technology

• Cone Navigation Failure: The vehicle's AI was unable to navigate around construction traffic cones.
• Uncontrolled Vehicle Movement: The autonomous vehicle repeatedly drove away as roadside support approached.
• System Coordination Deficit: Lack of integration between autonomous driving system and remote monitoring.

Data Inputs

• Improper Remote Guidance: Remote assistant provided incorrect routing data to the vehicle's planner.
• Unexpected Environment Changes: Unmapped construction cones disrupted the vehicle's localized map data.

Human Factors

• Operator Guidance Error: The remote operator gave improper instructions to the vehicle's system.

Process and Methods

• No Vehicle Halt Protocol: No command was issued to keep the vehicle stationary for ground support.
• Inadequate Handoff Process: Poor coordination between remote monitors and physical roadside assistance.

Information quality

• Classification confidence: High
• Reason for confidence: The incident is well-documented across multiple sources, including a first-hand video recording by the passenger and official statements from Waymo. The sequence of events is clear and consistent across reports.
• Ambiguities identified: The exact nature of the 'improper' guidance from the remote operator is not fully detailed.
• Alternative interpretations: None. The event is clearly a technical failure of an autonomous vehicle navigating a construction zone.

A Waymo autonomous vehicle became confused by construction cones in Arizona, blocking traffic and repeatedly driving away from roadside assistance. The incident represents a minor local traffic disruption with negligible national security implications, showcasing routine technical challenges in autonomous vehicle deployment.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: No clear primary
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. The incident represents a localized, resolved technical glitch with no immediate national security threat.
• Autonomy: Full autonomy. The vehicle operated and made driving decisions independently, including repeatedly driving away from roadside assistance personnel.
• Novelty: Established threat. Autonomous vehicle failures in construction zones and dynamic environments are known, established technical challenges.

Impact by dimension

• Physical security: Minor. The autonomous vehicle blocked a traffic lane and repeatedly drove away from roadside assistance, causing minor local traffic disruption, but resulted in no physical injuries or property damage.
• Information security: Negligible. No national security intelligence compromise, espionage, or information warfare operations were associated with this localized commercial driving incident.
• Sovereignty: Negligible. No threat to state authority, border control, electoral processes, or core government functions was observed.
• Economic security: Negligible. While representing a minor technical setback for a commercial autonomous vehicle developer, the incident does not threaten national economic or technological security.
• Societal stability: Negligible. No implications for civil liberties, mass surveillance, or societal stability were identified in this localized traffic event.