Reported Glitch in Waymo Self-Driving Cars Purportedly Triggers Regular All-Night Honking in San Francisco

Waymo self-driving cars in San Francisco's South of Market neighborhood reportedly began honking at each other late at night, disturbing residents' sleep. The autonomous vehicles, reportedly using a parking lot for ride pauses, triggered honking due to a purported glitch in their algorithms. Despite residents' complaints, the issue allegedly persisted for weeks until Waymo acknowledged the problem and began working on a fix.

Risk classification

• Primary risk domain: 7 AI system safety, failures, & limitations
• Primary risk subdomain: 7.3 Lack of capability or robustness

The Waymo vehicles exhibited a lack of robustness in their navigation and interaction algorithms, leading to inappropriate and repetitive honking behavior in parking lots.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The disturbance was caused by the autonomous decision-making of deployed Waymo vehicles reacting to each other, which was an unintended outcome of their navigation algorithms.

EU AI Act risk tier

• Risk tier: 2 High Risk

Risk Level 2: High Risk. The Waymo Driver is an AI system deployed in critical transport infrastructure, which has significant implications for public safety and public interest.

AI system and alleged parties

• AI system: Waymo self-driving cars (Waymo)
• AI purpose: Autonomous Driving; Navigation Assistant
• Behaviour type: Multi-agent
• Alleged developer: Waymo
• Alleged deployer: Waymo
• Alleged harmed parties: South of Market residents, South of Market businesses, San Francisco residents, General public of San Francisco

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

People affected

• Occurrences reported: 1
• People reportedly harmed: 2
• People reportedly exposed: 5

Potential causes

Management

• Inadequate Risk Assessment: Management failed to assess community noise impacts of vehicle depot operations.
• Slow Initial Response: Management did not address neighbor complaints until media inquiry.

Technology

• Automatic Honking Trigger: Vehicles automatically honk when other vehicles get close while backing up.
• Flawed Proximity Logic: Algorithms treat other backing-up Waymos as hazards requiring a horn warning.
• Lack of Depot Quiet Mode: Software lacks a quiet mode for vehicles navigating residential parking lots.

Data Inputs

• Proximity Sensor Inputs: Sensors detect nearby moving vehicles, triggering default safety honk rules.
• Lack of Environmental Context: System lacks data inputs indicating the vehicle is in a private parking lot.

Human Factors

• Lack of On-Site Operators: No human drivers present in the vehicles to stop the honking manually.
• No Local Contact Person: Neighbors have no direct human contact on-site to address immediate issues.

Process and Methods

• Inadequate Depot Testing: Testing processes failed to identify multi-car parking lot interaction issues.
• Slow Feedback Loop: Corporate response channels were slow to address neighbor complaints initially.

Regulatory Environment

• Lack of AV Noise Regulations: No specific local regulations governing autonomous vehicle noise in depots.

Information quality

• Classification confidence: High
• Reason for confidence: The reports provide clear, consistent, and detailed accounts of the incident from multiple residents and include Waymo's official response acknowledging the issue. The cause (algorithmic behavior during parking lot navigation) and the effects (sleep deprivation for neighbors) are explicitly stated without conflicting details.

An unintentional multi-agent algorithmic glitch caused autonomous Waymo vehicles to repeatedly honk at each other in a San Francisco parking lot, leading to sleep disruption for local residents. The incident represents a minor localized safety and noise issue with negligible implications for national security.

• Overall national security impact: Negligible
• Scope: Single nation
• Primary target: No clear primary
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. The incident represents a minor, localized software glitch that does not pose any immediate or near-term national security crisis.
• Autonomy: Full autonomy. The Waymo vehicles operated and interacted autonomously without human drivers or immediate oversight during the incident.
• Novelty: Established threat. Software bugs and unexpected sensor interactions in autonomous systems are known issues with established precedents.

Impact by dimension

• Physical security: Negligible. No physical threat or critical infrastructure compromise occurred. The incident was limited to localized vehicle honking in a parking lot.
• Information security: Negligible. No information warfare, intelligence compromise, or systematic manipulation of data was involved.
• Sovereignty: Negligible. The incident had no impact on state authority, electoral processes, or core government operations.
• Economic security: Negligible. No strategic technology theft, financial system damage, or critical supply chain disruption occurred.
• Societal stability: Negligible. While localized sleep disruption occurred for neighbors, it did not threaten social cohesion, civil liberties, or broader societal stability.