ZeroEyes AI Surveillance System Reportedly Flagged Clarinet as Gun, Triggering School Lockdown in Florida

An AI-powered ZeroEyes surveillance system deployed at a Florida middle school reportedly flagged a student's clarinet as a firearm, triggering a school lockdown and police response. Officers reportedly searched classrooms and questioned a student after the alert described a suspected weapon. No threat was reportedly found. The incident reportedly caused disruption to classes and subjected students and staff to lockdown conditions and police intervention despite the absence of an actual weapon.

Risk classification

• Primary risk domain: 7 AI system safety, failures, & limitations
• Primary risk subdomain: 7.3 Lack of capability or robustness

The AI threat-detection system failed to robustly distinguish between a musical instrument and a firearm, leading to a false positive alert.

Additional risk subdomains

• 5.1 Overreliance and unsafe use: School administrators and law enforcement relied on the automated AI alert to initiate a high-stress lockdown and armed police response before fully verifying the threat.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The incident was caused by the ZeroEyes AI system's false positive identification of a clarinet as a rifle after it was deployed in the school.

EU AI Act risk tier

• Risk tier: 2 High Risk

High Risk: The system is used for law enforcement and school safety threat detection, which has significant implications for public safety and fundamental rights. The report notes it is an 'AI-powered surveillance system used by Lawton Chiles Middle School' to 'alert law enforcement'.

AI system and alleged parties

• AI system: ZeroEyes threat-detection system (ZeroEyes)
• AI purpose: Threat Detection; Smart Surveillance
• Behaviour type: Assistant
• Alleged developer: ZeroEyes
• Alleged deployer: Seminole County Public Schools, Lawton Chiles Middle School
• Alleged harmed parties: Lawton Chiles Middle School students, Lawton Chiles Middle School staff

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Minor, indirect Minor
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Psychological

Reported: Yes, the report notes that threat detection systems misfiring puts students under undue suspicion and stress.

Directly caused: The student holding the clarinet was subjected to police questioning and undue suspicion, causing stress.

Indirectly caused: Students hiding in the band room and across the school experienced the anxiety and distress of an active school lockdown.

Inferred additional harm: It is likely that many of the estimated 500 students and staff experienced temporary acute anxiety and distress due to the lockdown and presence of armed police.

People affected

• Occurrences reported: 1
• People reportedly harmed: 1
• People reportedly exposed: 500

Potential causes

Management

• Tolerance of False Positives: Management prefers false alarms over the risk of missing a real threat.

Technology

• Object Misclassification: The AI system mistakenly flagged a clarinet as a shouldered rifle.
• Camera Distance Limitations: AI surveillance systems can miss threats if targets are too far from cameras.
• Overreliance on Visual Patterns: The system relies on visual matches of weapon-holding poses, causing errors.

Data Inputs

• Deceptive Visual Posture: The student held a clarinet in a manner resembling a shouldered rifle.
• Lack of Contextual Data: The system lacked situational data like the school's themed dress-up day.

Human Factors

• Human Reviewer Confirmation Bias: Evaluators err on the side of warning when AI flags a potential weapon.
• Student Playful Behavior: The student held the musical instrument in a military-style posture.

Process and Methods

• Proactive Alerting Bias: The verification process favors dispatching alerts even with minor doubts.
• Rapid Verification Pressure: Human reviewers must make split-second decisions, increasing error rates.

Regulatory Environment

• Unproven Tech Deployment: AI surveillance is deployed in schools without established safety standards.

Information quality

• Classification confidence: High
• Reason for confidence: The report provides a clear, detailed account of the specific false positive event, including the perspectives of the school, the AI developer, and external safety experts. The role of the AI is explicitly defined, and the sequence of events is well-documented.

An AI threat-detection system misidentified a student's clarinet as a rifle, triggering a localized middle school lockdown in Florida. The incident highlights ongoing reliability challenges and potential human-bias issues in AI surveillance, but carries negligible national security implications.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. Represents an ongoing strategic concern regarding the reliability of AI surveillance tools rather than an active crisis.
• Autonomy: Human-supervised. The AI threat detection system relies on human employees to review and validate alerts before law enforcement is notified.
• Novelty: Established threat. False positives in computer vision threat detection are a known and previously documented issue.

Impact by dimension

• Physical security: Minor. A localized false alarm triggered a school lockdown and police dispatch. While causing temporary disruption, the incident was fully manageable within standard local security procedures.
• Information security: Negligible. No information warfare, intelligence compromise, or systematic information manipulation occurred during this incident.
• Sovereignty: Negligible. No threat to state authority, electoral systems, or core federal government operations was present.
• Economic security: Negligible. No impact on strategic industries, financial systems, or national technological competitive advantage.
• Societal stability: Minor. Caused localized psychological stress and temporary suspicion of an innocent student, but did not threaten large-scale social cohesion or civil liberties.