Security Robot Drowns Itself in a Fountain

A Knightscope K5 security robot ran itself into a water fountain in Washington, DC.

Risk classification

• Primary risk domain: 7 AI system safety, failures, & limitations
• Primary risk subdomain: 7.3 Lack of capability or robustness

The robot failed to navigate its environment safely due to a technical error where its algorithm did not detect a loose brick surface and steps, leading to a physical crash.

Additional risk subdomains

• 2.1 Compromise of privacy by obtaining, leaking or correctly inferring sensitive information: The reports highlight ongoing public concerns regarding the robot's ability to record video, take photos, and monitor conversations in public spaces without clear signage.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The incident was caused by a navigation failure of the deployed Knightscope K5 robot, which autonomously steered itself down steps and into a fountain.

EU AI Act risk tier

• Risk tier: 2 High Risk

High Risk: The K5 robot is used for security and law enforcement purposes, utilizing facial recognition and license plate recognition to detect suspects, which aligns with High Risk applications under the EU AI Act.

AI system and alleged parties

• AI system: Knightscope K5 (Knightscope)
• AI purpose: Threat Detection; Smart Surveillance
• Behaviour type: Autonomous
• Alleged developer: Knightscope
• Alleged deployer: Knightscope
• Alleged harmed parties: Knightscope

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Minor, indirect Negligible
• Financial: direct Minor, indirect Minor
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Property

Reported: The reports explicitly describe property damage to the robot itself.

Directly caused: The Knightscope K5 robot, valued as commercial security property, was rendered defunct and permanently damaged after falling into the water fountain.

Financial

Reported: The reports do not explicitly state a specific dollar amount for the financial loss caused by the incident.

Directly caused: Average financial loss per occurrence: N/A. The direct loss includes the physical destruction of one K5 robot and the cost of providing a free replacement unit.

Indirectly caused: The indirect loss includes Knightscope providing a month of free service credit and an all-inclusive maintenance policy to the client.

Inferred additional harm: We can infer a moderate financial loss to Knightscope for the manufacturing cost of the replacement robot and the lost revenue from the free month of service credit.

People affected

• Occurrences reported: 1

Potential causes

Management

• Premature Public Deployment: Deploying the robot to map active public areas without safety escorts.
• Inadequate Risk Assessment: Management failed to assess risks posed by stairs and open fountains.

Technology

• Detection Algorithm Failure: Algorithm failed to detect the uneven loose brick surface.
• Sensor Detection Deficit: Lidar and cameras failed to distinguish water from solid ground.
• Armless Cone Design: Cone-shaped armless design made it impossible to self-right.

Data Inputs

• Loose Brick Surface: Uneven loose brick surface caused the robot to skid and lose traction.
• Incomplete Map Data: Robot was in mapping phase and lacked complete environmental data.

Human Factors

• Lack of Protective Barriers: Humans did not install physical barriers around the open fountain.
• Overreliance on Robot Autonomy: Staff left the robot unsupervised during its initial mapping phase.

Process and Methods

• Live Environment Mapping: Mapping complex public spaces directly instead of controlled testing.

Regulatory Environment

• Outpaced Public Safety Laws: Legislation for autonomous public robots has not kept pace with tech.

Information quality

• Classification confidence: High
• Reason for confidence: The reports are highly consistent, providing clear details of the event, the manufacturer's explanation from the black box, and the outcome.
• Ambiguities identified: Minor details about the exact cost of the damaged robot are not specified.
• Alternative interpretations: Some social media users jokingly interpreted the event as a 'robot suicide' due to work stress, though the technical reality was a simple navigation error on a slippery/uneven surface.

A commercial security robot suffered a localized navigation failure and fell into a fountain in Washington, D.C. The incident was entirely accidental, caused no human injuries or critical infrastructure damage, and has negligible national security implications.

• Overall national security impact: Negligible
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. The incident is a resolved, localized technical failure with no ongoing threat or strategic national security concern.
• Autonomy: Full autonomy. The robot operated and made navigation decisions autonomously without direct human supervision or intervention.
• Novelty: Established threat. Autonomous navigation failures on uneven surfaces are an established and well-known limitation of mobile robotic systems.

Impact by dimension

• Physical security: Negligible. The incident involved a commercial security robot failing to navigate a public fountain. No critical infrastructure was impacted, and there was no threat to human safety.
• Information security: Negligible. No classified models, intelligence capabilities, or sensitive data were compromised, leaked, or targeted during this incident.
• Sovereignty: Negligible. The incident was a localized technical malfunction of a commercial robot with no threat to state authority, elections, or government decision-making.
• Economic security: Negligible. Financial impact was limited to the loss of a single commercial robot, which was replaced free of charge by the manufacturer. No strategic tech theft occurred.
• Societal stability: Negligible. The incident did not cause mass surveillance deployment, civil unrest, algorithmic discrimination, or any erosion of human rights.