A Self-Driving Waymo Robotaxi Reportedly Collided with a Bicyclist

A Waymo robotaxi in San Francisco reportedly failed to detect a cyclist obscured by a truck, resulting in a collision with minor injuries, at 17th and Mississippi Streets in Potrero Hill. The incident reportedly demonstrated a vulnerability in autonomous vehicles' ability to safely navigate complex urban environments.

Risk classification

• Primary risk domain: 7 AI system safety, failures, & limitations
• Primary risk subdomain: 7.3 Lack of capability or robustness

The incident represents a lack of capability or robustness in the AI system's perception and reaction under occlusion, as it failed to anticipate the cyclist behind the truck and avoid the collision.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The collision was caused by the decision of the deployed Waymo autonomous vehicle to proceed into the intersection, resulting in an unintentional accident post-deployment.

EU AI Act risk tier

• Risk tier: 2 High Risk

High Risk: The system is an autonomous vehicle operating in public transport and traffic infrastructure, which has significant implications for public safety and critical infrastructure.

AI system and alleged parties

• AI system: Waymo robotaxi (Google)
• AI purpose: Autonomous Driving; Navigation Assistant
• Behaviour type: Autonomous
• Alleged developer: Waymo
• Alleged deployer: Waymo
• Alleged harmed parties: Bicyclist

Harm severity

Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

People affected

• Occurrences reported: 1
• People reportedly harmed: 1
• People reportedly exposed: 2

Potential causes

Management

• Premature Service Expansion: Waymo seeking service expansion before solving complex occlusion scenarios.

Technology

• Sensor Occlusion by Large Truck: Vehicle sensors could not see the cyclist who was hidden behind a truck.
• Inability to Predict Hidden Hazards: AV system failed to anticipate a hazard hidden behind the passing truck.
• Sub-human Level Safety Systems: Academic research indicates AV safety is not yet at human-level capability.

Data Inputs

• Blocked Sensor Field of View: Oncoming truck physically blocked sensor line of sight to the cyclist.

Human Factors

• Cyclist Sudden Left Turn: The cyclist turned left into the AV path immediately after following the truck.
• No Human Driver to Intervene: As a driverless vehicle, there was no human driver to anticipate the hazard.

Process and Methods

• Inadequate Defensive Driving Logic: AV did not assume a hidden road user could emerge from behind the truck.

Regulatory Environment

• Unresolved AV Safety Standards: Regulators still reviewing safety risks of autonomous vehicles on public roads.

Information quality

• Classification confidence: High
• Reason for confidence: The reports provide consistent, detailed accounts of the collision from multiple sources, including statements from Waymo, the police, and local officials. The sequence of events is clearly described, and the extent of the injuries is verified by first responders.
• Ambiguities identified: The exact number of passengers in the Waymo vehicle at the time of the crash is not specified, though police confirmed occupants reported no injuries.
• Alternative interpretations: One could argue the cyclist was primarily at fault for turning into the vehicle's path while obscured, rather than it being a pure AI failure, but the system's inability to anticipate the hazard still points to a robustness limitation.

A driverless Waymo vehicle collided with a cyclist in San Francisco, causing minor injuries. The incident was a localized, unintentional traffic accident resulting from sensor occlusion. It has negligible national security implications, representing a standard public safety and regulatory issue managed by local authorities rather than a threat to national security.

• Overall national security impact: Negligible
• Response level: Minor
• Scope: Single nation
• Primary target: No clear primary
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. The incident represents an isolated, localized event rather than an active crisis or imminent threat to national security.
• Autonomy: Full autonomy. The Waymo vehicle was operating fully autonomously without a human driver or active human supervision during the collision.
• Novelty: Established threat. Collisions involving autonomous vehicles and pedestrians or cyclists have occurred previously, representing an established safety challenge rather than a novel threat.

Impact by dimension

• Physical security: Negligible. The incident was a localized traffic accident involving a single autonomous vehicle and a cyclist, resulting in minor injuries. It poses no threat to critical infrastructure, military systems, or national physical security.
• Information security: Negligible. No information warfare, espionage, intelligence compromise, or systematic disinformation was associated with this traffic accident.
• Sovereignty: Negligible. The incident does not impact state authority, border control, electoral integrity, or core government decision-making processes.
• Economic security: Negligible. There was no theft of strategic technology, critical supply chain disruption, or threat to financial systems resulting from this localized collision.
• Societal stability: Negligible. While there is ongoing local public debate regarding autonomous vehicles, a single minor collision does not threaten social cohesion, civil liberties, or population-scale stability.