Driverless Cruise Cars Immobilized in San Francisco Traffic Jam

A fleet of Cruise's autonomous vehicles became unexpectedly immobilized on a busy San Francisco street, causing significant traffic disruption. The incident was attributed to wireless connectivity issues exacerbated by a nearby festival.

Risk classification

• Primary risk domain: 7 AI system safety, failures, & limitations
• Primary risk subdomain: 7.3 Lack of capability or robustness

The Cruise vehicles failed to operate reliably when cellular connectivity was lost, showing a lack of robustness under real-world environmental conditions.

Additional risk subdomains

• 6.5 Governance failure: The incident highlights regulatory oversight issues, as the CPUC approved unlimited fleet expansion over the objections of local transport and fire officials.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The incident was caused by the Cruise autonomous vehicles' decision to immobilize themselves in the middle of the street when they lost cellular connectivity post-deployment.

EU AI Act risk tier

• Risk tier: 2 High Risk

High Risk: The AI system is used in critical transport infrastructure, where failures can directly impact public safety and traffic management.

AI system and alleged parties

• AI system: Cruise autonomous vehicles (Cruise)
• AI purpose: Autonomous Driving; Navigation Assistant
• Behaviour type: Autonomous
• Alleged developer: Cruise
• Alleged deployer: Cruise
• Alleged harmed parties: General public

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

People affected

• Occurrences reported: 1
• People reportedly exposed: 100

Potential causes

Management

• Rapid Fleet Scaling: Management expanded operations without robust communication infrastructure.
• Inadequate Risk Assessment: Failed to plan for cell network congestion during large public events.

Technology

• Cellular Network Dependency: Robotaxis relied on public cell networks which failed under heavy load.
• No Offline Fallback Mode: Vehicles immobilized themselves completely when wireless connection was lost.
• Remote Control Dependency: Safe operation and rerouting depended on remote human operator connectivity.

Data Inputs

• Loss of Telemetry Data: Overloaded cell towers prevented real-time telemetry from reaching servers.

Human Factors

• Crowd Network Overuse: Festival attendees overtaxed cell network, indirectly disabling AVs.

Process and Methods

• Inadequate Contingency Rerouting: No effective local or offline protocol to handle vehicle connectivity loss.
• Lack of Local Network Redundancy: No backup communication channels were established for high-density events.

Regulatory Environment

• Premature Expansion Approval: CPUC lifted restrictions despite warnings of disruptive incidents.
• Absence of Fleet Size Caps: Regulators did not limit fleet size, compounding potential traffic impacts.
• Lack of Mandatory Fleet Reporting: Companies are not required to report active vehicle numbers to regulators.

Information quality

• Classification confidence: High
• Reason for confidence: The report clearly details the cause of the incident (cellular network congestion from a festival), the system behavior (stalling with hazard lights), and the immediate consequences (traffic backup on a narrow street).

A fleet of Cruise autonomous vehicles stalled in San Francisco due to cellular network congestion, highlighting a minor critical infrastructure vulnerability. While the incident caused only localized traffic disruption with no malicious intent, it underscores systemic risks associated with deploying autonomous systems reliant on public communications infrastructure.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. Represents an ongoing strategic concern regarding the integration of autonomous vehicle fleets with public cellular networks.
• Autonomy: Human-supervised. Vehicles operate autonomously in traffic but rely on cellular connectivity for remote human oversight and backup intervention.
• Novelty: Evolved capability. Demonstrates an evolved capability failure mode where public network congestion can simultaneously disable multiple autonomous systems.

Impact by dimension

• Physical security: Minor. Temporary blockage of public roads by stalled autonomous vehicles created localized traffic disruption and potential emergency vehicle obstruction, representing a minor vulnerability in critical transport infrastructure.
• Information security: Negligible. No information warfare, intelligence compromise, or systematic information manipulation occurred during this incident.
• Sovereignty: Negligible. The incident involved local municipal traffic and regulatory debates but did not threaten state authority or core government operations.
• Economic security: Negligible. No threat to financial systems, strategic technology theft, or significant economic disruption was identified.
• Societal stability: Negligible. While causing public frustration, the incident did not threaten societal stability, civil liberties, or human rights.