York County, South Carolina, Deputies Reportedly Held Local Motorist at Gunpoint After Flock Safety License-Plate Reader Misread

Steven Melvin, a 42-year-old York County, South Carolina, motorist was reportedly detained at gunpoint for more than five minutes after a Flock Safety automated license-plate reader misidentified the first letter of his plate and matched his BMW to a similar stolen vehicle. The sheriff’s office later said an illegal tinted plate cover caused the malfunction and found the deputy’s actions “reasonable”; Flock said alerts should be independently verified before enforcement.

Risk classification

• Primary risk domain: 7 AI system safety, failures, & limitations
• Primary risk subdomain: 7.3 Lack of capability or robustness

The primary failure lies within the AI system's lack of robustness in accurately reading license plates under real-world conditions, such as when a plate cover is present, leading to a critical false positive.

Additional risk subdomains

• 5.1 Overreliance and unsafe use: The deputy immediately drew his weapon and detained the driver based solely on the automated alert, demonstrating unsafe overreliance on the technology without independent verification.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The incident was caused by a post-deployment malfunction of the Flock AI camera system, which unintentionally misread a license plate character and generated a false positive alert.

EU AI Act risk tier

• Risk tier: 2 High Risk

High Risk: The system is used in law enforcement applications, specifically for automated surveillance and license plate recognition, which has significant implications for public safety and fundamental civil rights.

AI system and alleged parties

• AI system: Flock Safety automated license-plate reader (Flock Safety)
• AI purpose: License Plate Recognition; Threat Detection
• Behaviour type: Tool
• Alleged developer: Surveillance technology developers, Flock Safety, Automated license plate reader (ALPR) developers
• Alleged deployer: York County Sheriff's Office (South Carolina), Police departments in the United States, Law enforcement, Kyle Brogden
• Alleged harmed parties: Steven Melvin, Road users, Motorists, Epistemic integrity, Drivers

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Minor, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Minor, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Civil rights

Reported: The report explicitly describes a violation of civil rights, as the victim was wrongfully detained and held at gunpoint based on a false alert.

Directly caused: Melvin's civil liberties were violated when he was wrongfully detained and subjected to a high-risk traffic stop without reasonable cause.

Inferred additional harm: Numerous other drivers pulled over or jailed due to incorrect hotlist matches experienced violations of their Fourth Amendment rights against unreasonable seizure.

Psychological

Reported: The report explicitly describes psychological harm, noting that the victim suffered trauma and emotional distress from being held at gunpoint.

Directly caused: One individual, Melvin, suffered severe emotional distress and trauma after being forced to kneel at gunpoint for over five minutes.

Inferred additional harm: Other individuals nationwide who were repeatedly pulled over or wrongfully jailed due to Flock errors likely suffered similar psychological trauma.

People affected

• Occurrences reported: 1
• People reportedly harmed: 1
• People reportedly exposed: 1

Potential causes

Management

• Defensive Organizational Culture: The sheriff's office cleared the officer of wrongdoing despite clear errors.
• Inadequate Risk Assessment: Management failed to assess risks of wrongful detentions from false positives.

Technology

• Character Misidentification: The Flock camera incorrectly read the first letter of the license plate.
• Algorithmic Fragility: The OCR algorithm failed to handle minor visual distortions on the plate.
• Frequent Misreads: Systemic issues exist where 1 in 10 scans misread the state identifier.

Data Inputs

• Obscured License Plate: A tinted license plate cover physically degraded the visual input to the AI.
• Hotlist Inaccuracies: Stolen vehicle databases and hotlists sometimes contain errors or old data.

Human Factors

• Lack of Independent Verification: The deputy failed to manually verify the plate before drawing his weapon.
• Automation Bias: Law enforcement over-relied on the automated alert as absolute truth.
• Aggressive Escalation: The officer immediately held the driver at gunpoint based solely on an alert.

Process and Methods

• Flawed SOPs: Standard operating procedures did not mandate verification before high-risk stops.
• Inadequate Training: Officers were not sufficiently trained to treat AI alerts as investigative leads.

Regulatory Environment

• Lack of AI Standards: No federal standards exist to regulate the accuracy of police AI surveillance.
• Inadequate Oversight: There is minimal regulatory oversight on the deployment of automated ALPR systems.

Information quality

• Classification confidence: High
• Reason for confidence: The report provides clear, factual details of the specific traffic stop, including names, dates, locations, and the technical reason for the system's failure. It also provides broader context on similar failures nationwide.
• Ambiguities identified: There is a minor dispute between the sheriff's office claiming the tinted cover caused the malfunction and the plaintiff's evidence showing the camera read the plate successfully 13 times prior.
• Alternative interpretations: None. The incident is a clear-cut case of an algorithmic false positive leading to a wrongful police detention.

A local law enforcement officer held a driver at gunpoint due to a false positive from a Flock Safety license plate reader. While raising civil liberties and operational safety concerns regarding police overreliance on automated alerts, the incident remains a localized policing issue with negligible national security implications.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. This represents an ongoing, post-deployment operational risk of automated police tools rather than an active, imminent national security crisis.
• Autonomy: Human-supervised. The AI system flagged the plate autonomously, but human law enforcement officers made the final decision to initiate the high-risk traffic stop and detain the suspect.
• Novelty: Established threat. False positives from automated license plate readers and facial recognition leading to wrongful detentions have been documented in previous incidents.

Impact by dimension

• Physical security: Minor. While a citizen was held at gunpoint, this represents a localized police intervention rather than a systemic threat to physical systems, critical national infrastructure, or mass civilian safety.
• Information security: Negligible. No foreign intelligence compromise, classified model theft, or systematic information warfare campaign is indicated in this local law enforcement failure.
• Sovereignty: Minor. The incident represents a localized failure of municipal police procedures and automated tools, but does not threaten state authority, constitutional processes, or core federal government operations.
• Economic security: Negligible. No strategic technology theft, critical supply chain disruption, or systemic threats to financial markets occurred.
• Societal stability: Minor. The incident highlights civil liberties concerns and wrongful detention of individuals due to algorithmic false positives, but does not scale to systematic national oppression or widespread civil unrest.