A shopping guide robot at a mall in Fuzhou autonomously navigated onto an escalator, resulting in a fall that knocked over two passengers. The mall suspended the use of the robot, and the manufacturer initiated an investigation into the cause of the malfunction.
A shopping guide robot deployed by the Fuzhou Zhongfang Marlboro Mall was shown on video allegedly walking to the escalator by itself, falling down, and knocking over passengers, which prompted its suspension.
Risk classification
- Primary risk domain: 7 AI system safety, failures, & limitations
- Primary risk subdomain: 7.3 Lack of capability or robustness
The robot failed to navigate its environment safely, failing to detect or avoid the escalator hazard, which represents a lack of capability or robustness in its navigation system.
Causal factors
- Entity: AI
- Intent: Unintentional
- Timing: Post-deployment
The incident was caused by the robot's autonomous navigation system making an unintended decision to walk onto an escalator post-deployment.
EU AI Act risk tier
- Risk tier: 4 Minimal or No Risk
Minimal or No Risk: The shopping guide robot is used in a retail environment for customer service and does not fall under high-risk categories such as critical infrastructure or law enforcement.
AI system and alleged parties
- AI system: None named
- AI purpose: Navigation Assistant; Smart Devices
- Behaviour type: Autonomous
- Alleged developer: unknown
- Alleged deployer: Fuzhou Zhongfang Marlboro Mall
- Alleged harmed parties: Fuzhou Zhongfang Marlboro Mall goers
Harm severity
Severity ratings are based on this scale.
Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
- Physical: direct Negligible, indirect Negligible
- Infrastructure: direct Negligible, indirect Negligible
- Property: direct Negligible, indirect Negligible
- Financial: direct Negligible, indirect Negligible
- Environmental: direct Negligible, indirect Negligible
- Malicious content: direct Negligible, indirect Negligible
- Differential treatment: direct Negligible, indirect Negligible
- Civil rights: direct Negligible, indirect Negligible
- Democracy: direct Negligible, indirect Negligible
- Privacy: direct Negligible, indirect Negligible
- Psychological: direct Negligible, indirect Negligible
- Epistemic: direct Negligible, indirect Negligible
- Child sexual exploitation and abuse: direct Negligible, indirect Negligible
People affected
- Occurrences reported: 1
- People reportedly harmed: 2
- People reportedly exposed: 2
Potential causes
Management
- Inadequate Deployment Protocols: The robot was deployed without physical barriers near hazards.
Technology
- Autonomous Navigation Failure: The robot autonomously navigated onto a dangerous escalator area.
- Inadequate Obstacle Detection: Sensors failed to detect the escalator drop-off or hazard.
Data Inputs
- Lack of Spatial Mapping Data: The robot lacked map data identifying escalators as no-go zones.
Human Factors
- Lack of Active Human Monitoring: No human operator was monitoring the robot's autonomous pathing.
Process and Methods
- Insufficient Risk Testing: The robot's navigation was not fully tested near escalators.
Information quality
- Classification confidence: High
- Reason for confidence: The reports are brief but clearly outline the physical event, the autonomous nature of the robot's movement, and the lack of serious injuries. There are no conflicting accounts.
- Ambiguities identified: The exact technical failure that allowed the robot to navigate onto the escalator is not specified.
A commercial shopping guide robot in Fuzhou, China, autonomously navigated onto an escalator and fell, causing minor contact with two passengers. The incident was a localized, unintentional technical malfunction with negligible national security implications.
- Overall national security impact: Negligible
- Scope: Single nation
- Primary target: No clear primary
- Alleged perpetrator: Unknown
Threat characteristics
- Imminence: Long-term. The incident is a past, resolved local event with no ongoing threat or national security implications.
- Autonomy: Full autonomy. The robot navigated onto the escalator autonomously without human operation or direct supervision.
- Novelty: Established threat. Navigation failures in simple commercial service robots are established technical limitations and do not represent a novel threat capability.
Impact by dimension
- Physical security: Negligible. A localized commercial robot malfunction resulting in minor contact with two mall patrons, posing no threat to critical infrastructure or national physical security.
- Information security: Negligible. No information warfare, intelligence compromise, or systematic information manipulation occurred during this commercial incident.
- Sovereignty: Negligible. The incident was a localized safety failure in a retail environment with no impact on state authority, territorial control, or government operations.
- Economic security: Negligible. The incident involves minor commercial damage and pose no threat to strategic industries, financial systems, or national technological advantages.
- Societal stability: Negligible. A minor accidental physical mishap in a shopping mall has no implications for societal stability, civil liberties, or population-scale safety.
.avif){kind=small}