On July 7, 2024, a Baidu 'Apollo' Robotaxi (branded as 'Luobo Kuaipao') collided with a pedestrian at an intersection in Wuhan, China. The company stated the vehicle made minor contact with a pedestrian who was crossing against a red light as the vehicle started moving on a green light. The incident has prompted discussions regarding liability for L4 autonomous vehicles and reports of previous operational issues, such as vehicles stalling or entering intersections incorrectly.
On July 7, 2024, a Baidu Robotaxi reportedly collided with a pedestrian at a traffic intersection in Wuhan. The incident occurred as the autonomous vehicle started moving on a green light while the pedestrian was allegedly crossing against a red light. The pedestrian sustained minor injuries, and Baidu was reported to have been cooperating with local authorities for further investigation.
Risk classification
- Primary risk domain: 7 AI system safety, failures, & limitations
- Primary risk subdomain: 7.3 Lack of capability or robustness
The incident involves an autonomous vehicle failing to safely navigate an intersection and making contact with a pedestrian, as well as other reported robustness issues like stalling and causing traffic congestion.
Causal factors
- Entity: AI
- Intent: Unintentional
- Timing: Post-deployment
The collision occurred during the post-deployment operation of Baidu's autonomous vehicle, representing an unintentional and unexpected outcome of its driving system.
EU AI Act risk tier
High Risk: The system is an autonomous vehicle used in critical transport infrastructure, which has significant implications for public safety and physical harm.
AI system and alleged parties
- AI system: 萝卜快跑 L4 (Baidu)
- AI purpose: Autonomous Driving; Navigation Assistant
- Behaviour type: Autonomous
- Alleged developer: Baidu
- Alleged deployer: Baidu
- Alleged harmed parties: Unnamed pedestrian
Harm severity
Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
- Physical: direct Negligible, indirect Negligible
- Infrastructure: direct Negligible, indirect Negligible
- Property: direct Negligible, indirect Negligible
- Financial: direct Negligible, indirect Negligible
- Environmental: direct Negligible, indirect Negligible
- Malicious content: direct Negligible, indirect Negligible
- Differential treatment: direct Negligible, indirect Negligible
- Civil rights: direct Negligible, indirect Negligible
- Democracy: direct Negligible, indirect Negligible
- Privacy: direct Negligible, indirect Negligible
- Psychological: direct Negligible, indirect Negligible
- Epistemic: direct Negligible, indirect Negligible
- Child sexual exploitation and abuse: direct Negligible, indirect Negligible
People affected
- Occurrences reported: 1
- People reportedly harmed: 1
- People reportedly exposed: 1
Potential causes
Management
- Premature Public Road Deployment: Deploying testing vehicles in busy urban areas before tech is fully mature.
Technology
- Delayed Reaction in Complex Traffic: Robotaxi exhibits slow reactions in complex traffic, causing issues.
- System Freezing During Turns: Vehicles freeze or experience lag when attempting to make turns.
- Improper Stopping at Green Lights: Vehicles stop or fail to proceed when traffic lights turn green.
Data Inputs
- Dynamic Obstacle Detection Lag: System delayed in detecting pedestrian entering its path during green light.
Human Factors
- Pedestrian Jaywalking: The pedestrian crossed the street against a red light, entering vehicle path.
Process and Methods
- Ongoing Vehicle Debugging: Vehicles were operating on public roads while still undergoing debugging.
Regulatory Environment
- Unclear Liability Framework: Lack of unified national regulations for L4 autonomous driving liability.
Information quality
- Classification confidence: High
- Reason for confidence: The report provides clear details about the collision, including the date, location, parties involved, and statements from both Baidu and industry experts. The context of the accident is well-defined, though the exact severity of the pedestrian's injuries is described only as 'minor contact' requiring hospital observation.
- Ambiguities identified: The exact physical condition and injuries of the pedestrian are not fully detailed beyond 'minor contact' and 'hospital observation'.
- Alternative interpretations: The incident could be interpreted primarily as pedestrian negligence due to crossing on a red light, rather than an AI safety failure, though the AI's failure to avoid contact still constitutes a safety event.
A Baidu Apollo robotaxi collided with a pedestrian crossing against a red light in Wuhan, China, causing minor injuries. The incident highlights ongoing localized safety, technical, and regulatory challenges for Level 4 autonomous vehicles but carries negligible national security implications.
- Overall national security impact: Negligible
- Response level: Minor
- Scope: Single nation
- Primary target: China
- Alleged perpetrator: Unknown
Threat characteristics
- Imminence: Long-term. The event reflects ongoing, long-term technological and regulatory challenges of autonomous vehicle deployment rather than an active security crisis.
- Autonomy: Full autonomy. The Baidu Apollo robotaxi was operating as a Level 4 autonomous vehicle, navigating and executing decisions without a human driver.
- Novelty: Established threat. Collisions and traffic disruptions involving autonomous test vehicles are established occurrences globally and do not represent a novel threat vector.
Impact by dimension
- Physical security: Negligible. A localized commercial robotaxi collision with a pedestrian in Wuhan represents a standard traffic safety issue with negligible national security implications.
- Information security: Negligible. No information warfare, intelligence compromise, or cyber espionage elements are associated with this localized commercial autonomous vehicle accident.
- Sovereignty: Negligible. The incident involves a domestic commercial enterprise operating within China, posing no threat to state sovereignty or core government functions.
- Economic security: Negligible. While raising regulatory questions for Chinas L4 autonomous vehicle sector, the incident poses no threat to national economic stability or strategic technological control.
- Societal stability: Negligible. The incident caused minor public debate on autonomous vehicle safety and liability but presents no threat to social cohesion, civil liberties, or human rights.