Cruise Taxis' Sudden Braking Allegedly Put People at Risk

Cruise's autonomous taxis slowed suddenly, braked, and were hit from behind, allegedly becoming unexpected roadway obstacles and potentially putting passengers and other people at risk.

Risk classification

• Primary risk domain: 7 AI system safety, failures, & limitations
• Primary risk subdomain: 7.3 Lack of capability or robustness

The Cruise vehicles failed to perform reliably under normal driving conditions, exhibiting unexpected hard braking and immobilization failures that created safety hazards.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The safety risks and collisions were caused by the Cruise Automated Driving System's unexpected behaviors, such as hard braking and immobilization, during post-deployment operations on public roads.

EU AI Act risk tier

• Risk tier: 2 High Risk

High Risk: The Cruise Automated Driving System is an AI system used in critical infrastructure and safety-critical transport applications. According to the EU AI Act definitions, AI systems in critical infrastructure (such as road traffic management and autonomous vehicles) are classified as High Risk (Level 2) due to their potential to cause physical harm and disrupt public safety.

AI system and alleged parties

• AI system: Cruise Automated Driving System (Cruise)
• AI purpose: Autonomous Driving; Navigation Assistant
• Behaviour type: Autonomous
• Alleged developer: Cruise
• Alleged deployer: Cruise
• Alleged harmed parties: traffic participants, emergency vehicles, Cruise passengers, Cruise

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Minor, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Property

Reported: The report explicitly describes property damage in the form of rear-end collisions involving Cruise vehicles and other road users.

Directly caused: Three Cruise vehicles were struck from behind by other road users after initiating hard braking maneuvers, causing vehicle damage.

Inferred additional harm: The other vehicles that rear-ended the Cruise robotaxis likely sustained front-end damage, but the specific value and extent of this damage are not detailed in the reports.

People affected

• Occurrences reported: 1
• People reportedly exposed: 10

Potential causes

Management

• Aggressive Expansion Targets: Pressure to scale to new cities and meet high financial projections.
• Pacing of Safety Recalls: Company delayed addressing systematic braking issues across the fleet.

Technology

• Unsafe Hard Braking Logic: ADS software triggers sudden braking when rear vehicles approach rapidly.
• System Immobilization Bugs: Technical faults cause vehicles to stop and strand passengers in traffic.
• Left Turn Prediction Error: Software incorrectly predicts oncoming vehicle paths during unprotected turns.

Data Inputs

• Rear Vehicle Proximity Data: Sensors detect fast rear approach but trigger oversensitive braking reactions.
• Oncoming Vehicle Trajectory: Inaccurate tracking of oncoming traffic path leads to sudden stops.

Human Factors

• Absence of Safety Drivers: Immobilization occurred in driverless mode with no human to take control.
• Rear Driver Reaction Time: Human drivers behind the AV cannot react in time to unexpected hard braking.

Process and Methods

• Flawed Safety Decision Logic: Decision algorithms fail to balance front and rear collision risks.
• Incomplete ODD Validation: Testing failed to identify all causes of unexpected vehicle immobilization.

Regulatory Environment

• Rapid Regulatory Approvals: Regulators permitted expansion before safety investigations were complete.

Information quality

• Classification confidence: High
• Reason for confidence: The reports are highly credible, originating from the federal safety regulator (NHTSA) and reputable news outlets (NYT, Ars Technica). They clearly describe the nature of the technical failures (hard braking and immobilization), the regulatory response, and the safety implications. While the exact number of immobilization incidents is not fully quantified, the overall scope of the safety issue and the AI's role are explicitly detailed.
• Ambiguities identified: The exact number of vehicle immobilization incidents is described as 'multiple' but is not precisely quantified in the reports.
• Alternative interpretations: None. The incidents are clearly characterized as technical failures of an autonomous driving system under regulatory investigation.

The NHTSA opened an investigation into Cruise autonomous vehicles following incidents of unexpected braking and traffic immobilization. While these failures obstructed emergency vehicles and caused minor collisions, they represent a localized public safety and regulatory issue rather than a threat to national security.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: No clear primary
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. Refers to ongoing regulatory evaluation of autonomous vehicle safety rather than an active national security crisis.
• Autonomy: Full autonomy. The vehicles were operating as driverless robotaxis without onboard human drivers when the immobilization incidents occurred.
• Novelty: Evolved capability. Represents an escalation in the scale of autonomous vehicle failures, leading to a federal safety investigation into fleet-wide behavior.

Impact by dimension

• Physical security: Minor. Autonomous vehicle failures caused traffic blockages and obstructed emergency response vehicles, representing a minor localized disruption to physical safety and emergency infrastructure.
• Information security: Negligible. No intelligence compromise, espionage, or information warfare elements were associated with these autonomous vehicle operational failures.
• Sovereignty: Negligible. The incident involved standard domestic regulatory oversight by the NHTSA and did not threaten state sovereignty or core government functions.
• Economic security: Negligible. While representing a setback for Cruise and GM, the technical failures did not threaten national economic stability or strategic technological competitiveness.
• Societal stability: Negligible. The incidents caused minor local public inconvenience and safety concerns but did not impact broader societal stability or human rights.