Omnilert AI Reportedly Triggered False Gun Alert at Parkville High, Prompting Student Relocation

Police in Baltimore County responded to Parkville High School after the Omnilert AI security system reportedly detected what it believed to be a gun. Officers searched the school, and students were relocated to a supervised area during the investigation. No weapon was found, and normal activities resumed after an all-clear.

Risk classification

• Primary risk domain: 7 AI system safety, failures, & limitations
• Primary risk subdomain: 7.3 Lack of capability or robustness

The incident was caused by the AI system's lack of robustness and capability, as it failed to accurately distinguish between a bag of chips or other non-threatening objects and a gun.

Additional risk subdomains

• 5.1 Overreliance and unsafe use: School officials called for more human oversight because police responded directly to the AI's unverified reports, demonstrating unsafe overreliance on the system's outputs.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The false gun alerts were caused by the Omnilert AI system incorrectly identifying objects post-deployment, which was an unintentional failure of its threat detection capabilities.

EU AI Act risk tier

• Risk tier: 2 High Risk

Risk Level 2. The system is used for safety and security in an educational institution, and its outputs directly trigger law enforcement responses, which has significant implications for safety and fundamental rights.

AI system and alleged parties

• AI system: Omnilert AI (Omnilert)
• AI purpose: Threat Detection; Smart Surveillance
• Behaviour type: Assistant
• Alleged developer: Omnilert
• Alleged deployer: Parkville High School, Baltimore County Public Schools
• Alleged harmed parties: Students of Parkville High School, Baltimore County Public Schools community

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Minor
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Minor
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Civil rights

Reported: Yes

Indirectly caused: The AI's false positive alert indirectly led to police officers handcuffing innocent teenage students at Kenwood High School, violating their civil liberties.

Inferred additional harm: The unnecessary detention and handcuffing of students represents a temporary deprivation of liberty and violation of civil rights for those affected.

Psychological

Reported: Yes

Indirectly caused: The false alerts caused a stir and led to teenage students being handcuffed and others relocated, which likely caused significant distress and anxiety.

Inferred additional harm: It is highly likely that the handcuffed teenagers and relocated students experienced acute anxiety and psychological distress due to the sudden police intervention.

People affected

• Occurrences reported: 2
• People reportedly harmed: 5
• People reportedly exposed: 100

Potential causes

Management

• Deficient Training Programs: Management failed to provide annual training on Omnilert protocols.
• Inadequate Risk Assessment: Lack of clear escalation procedures for AI-generated alerts.

Technology

• False Positive Weapon Detection: AI algorithm misidentified a bag of chips as a firearm.
• Inability to Differentiate Objects: The system lacked precision to distinguish everyday items from weapons.

Data Inputs

• Visual Similarity in Inputs: Visual features of a bag of chips closely resembled a gun profile.

Human Factors

• Inadequate Human Verification: Humans failed to properly verify the AI threat alert before police action.
• Lack of Operator Training: Operators lacked sufficient training on verifying AI-flagged alerts.

Process and Methods

• Flawed Response Protocol: Police responded to unverified Omnilert reports without confirmation.
• Lack of Verification Step: The verification workflow was bypassed or rushed during the incident.

Information quality

• Classification confidence: High
• Reason for confidence: The report clearly outlines the AI system involved, the nature of the false positives, the specific schools affected, and the real-world consequences such as police response and student detention.
• Ambiguities identified: The exact number of students handcuffed at Kenwood High School is not specified beyond 'teenage students'.

An AI threat detection system at Baltimore County schools generated multiple false positives, leading to police deployments and the temporary handcuffing of innocent students. While the incident highlights the risks of AI overreliance and its localized impact on civil liberties, it has negligible national security implications.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. Represents an ongoing, localized operational risk of AI deployment in public safety rather than an active national security crisis.
• Autonomy: Human-supervised. The AI system was designed to flag threats for human verification, though systemic failures and human overreliance led to unverified police dispatch.
• Novelty: Established threat. False positives in computer vision and computer-aided dispatch systems are well-documented and represent an established technical limitation.

Impact by dimension

• Physical security: Negligible. Localized false alarms in school security systems with no threat to critical infrastructure, kinetic attacks, or national physical security.
• Information security: Negligible. No elements of information warfare, intelligence compromise, or systematic manipulation of information.
• Sovereignty: Negligible. Limited to local school administration and local police protocols, with no impact on state sovereignty or core government functions.
• Economic security: Negligible. No impact on strategic industries, national economic stability, or international technological competitive advantage.
• Societal stability: Minor. Minor localized impact on civil liberties, where AI false positives led to police temporarily handcuffing innocent students, highlighting risks of algorithmic overreliance in public spaces.