Alleged False Positive by Omnilert AI Gun Detection System Prompts Police Search at Baltimore County High School

A purportedly AI-powered gun detection system at Kenwood High School in Baltimore County, Maryland, reportedly misidentified a student's empty Doritos bag as a firearm. Armed police reportedly detained and handcuffed the student before determining there was no weapon. The AI system, operated by Omnilert, issued the false alert, leading to public outcry and an official review of school security protocols. Omnilert reportedly expressed regret for the incident.

Risk classification

• Primary risk domain: 7 AI system safety, failures, & limitations
• Primary risk subdomain: 7.3 Lack of capability or robustness

The AI system failed to perform robustly under real-world conditions by misidentifying a common object (a bag of chips) as a lethal weapon, leading to severe real-world consequences.

Additional risk subdomains

• 5.1 Overreliance and unsafe use: School staff acted on the AI's initial alert and initiated a high-stakes police response before fully verifying the system's canceled status.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The incident was triggered by a false positive error from the deployed Omnilert AI system, which was an unexpected outcome of its threat detection goal.

EU AI Act risk tier

• Risk tier: 2 High Risk

High Risk: The AI system is used for safety and threat detection in an educational institution, which directly interfaces with law enforcement response, significantly impacting the safety and fundamental rights of students.

AI system and alleged parties

• AI system: Omnilert AI Gun Detection System (Omnilert)
• AI purpose: Threat Detection; Smart Surveillance
• Behaviour type: Assistant
• Alleged developer: Omnilert
• Alleged deployer: Baltimore County Public Schools
• Alleged harmed parties: Taki Allen, Kenwood High School students

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Minor
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Minor
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Civil rights

Reported: The report describes a situation where a student was handcuffed, searched, and detained by police due to a false alarm.

Indirectly caused: The AI's false positive alert indirectly led to the student being subjected to an invasive search, physical restraint, and detention by armed police without actual cause, impacting his civil rights.

Psychological

Reported: The report explicitly describes severe psychological distress experienced by the student during the incident.

Indirectly caused: The student experienced acute fear and trauma, stating 'was I about to die?' when approached by police with guns drawn. Other student witnesses were also reported as being highly upset, requiring counseling support.

Inferred additional harm: The student and witnesses likely suffered ongoing anxiety, fear of police, and a diminished sense of safety at school following the traumatic event.

People affected

• Occurrences reported: 1
• People reportedly harmed: 1
• People reportedly exposed: 5

Potential causes

Management

• Lack of Clear Procedures: School board lacked clear protocols for handling AI gun alerts.
• Inadequate System Safeguards: Lack of safeguards to prevent false alarms from escalating to police.

Technology

• AI Computer Vision Error: The AI system mistook a Doritos bag for a firearm based on shape.
• Vision-Based Limitations: The system can only identify what is visible to the security cameras.

Data Inputs

• Misleading Visual Input: The student holding the chip bag closely resembled a gun pose.

Human Factors

• Communication Oversight: The principal did not realize the alert had already been canceled.
• Aggressive Police Response: Officers responded with drawn guns and handcuffed an unarmed student.

Process and Methods

• Flawed Alert Cancellation Flow: The canceled alert did not stop the principal from contacting police.
• Inadequate Verification Process: The multi-step human verification failed to prevent police escalation.

Information quality

• Classification confidence: High
• Reason for confidence: The reports provide highly consistent, detailed accounts of the incident, including direct quotes from the affected student, school administrators, local councilmembers, and the AI developer. The sequence of events is clear and uncontested.
• Ambiguities identified: The exact communication lag between the school safety department canceling the alert and the principal notifying the SRO is slightly unclear.
• Alternative interpretations: None. The incident is clearly a false positive detection leading to an unwarranted police response.

An AI gun detection system's false positive misidentified a student's bag of chips as a firearm, triggering a high-stakes police response where a student was held at gunpoint. While raising local civil rights and public safety AI reliability concerns, the incident has negligible national security implications.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. The immediate incident is resolved, representing an ongoing policy and reliability concern for public safety AI deployments.
• Autonomy: Human-supervised. The AI system operates autonomously to detect and flag threats, but requires human verification and intervention before law enforcement action.
• Novelty: Established threat. Computer vision false positives and misidentifications are well-established technical limitations of existing AI models.

Impact by dimension

• Physical security: Minor. AI failure led to a false firearm detection, triggering an armed police response that directly endangered a student's physical safety, though localized to a single school.
• Information security: Negligible. No information warfare, espionage, or intelligence compromise occurred during this localized false positive event.
• Sovereignty: Negligible. Local school administration and police response procedures were disrupted, but there was no threat to state sovereignty or core federal government functions.
• Economic security: Negligible. No strategic technology theft, financial system impact, or loss of national technological competitive advantage.
• Societal stability: Minor. The incident resulted in a localized civil rights issue, where a student was detained and searched without cause due to an algorithmic error.