New Jersey Police Wrongful Arrested Innocent Black Man via FRT

Woodbridge Police Department falsely arrested an innocent Black man following a misidentification by their facial recognition software, who was jailed for more than a week and paid thousands of dollar for his defense.

Risk classification

• Primary risk domain: 1 Discrimination & Toxicity
• Primary risk subdomain: 1.3 Unequal performance across groups

The facial recognition software exhibited unequal performance across demographic groups, specifically failing to accurately identify Black faces, which directly led to the wrongful arrest of Nijeer Parks.

Additional risk subdomains

• 5.1 Overreliance and unsafe use: Law enforcement officers overrelied on the facial recognition match as definitive proof of identity, ignoring the lack of supporting forensic evidence and the user's alibi.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The incident was caused by a false match produced by the facial recognition AI system during its active deployment.

EU AI Act risk tier

• Risk tier: 2 High Risk

High Risk: The AI system is used in law enforcement applications, specifically facial recognition, which is explicitly classified as High Risk under the EU AI Act.

AI system and alleged parties

• AI system: facial recognition software
• AI purpose: Face Recognition; Identification
• Behaviour type: Assistant
• Alleged developer: unknown
• Alleged deployer: Woodbridge Police Department
• Alleged harmed parties: Nijeer Parks

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Minor, indirect Substantial
• Civil rights: direct Minor, indirect Minor
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Severe
• Psychological: direct Minor, indirect Minor
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Differential treatment

Reported: The report explicitly describes differential treatment of Black individuals due to the technology's racial bias.

Directly caused: The facial recognition software performed worse on Black faces, leading to the false identification and subsequent wrongful arrest of Nijeer Parks, a Black man.

Indirectly caused: The systemic deployment of biased facial recognition technology disproportionately subjects Black communities to higher risks of wrongful police interrogation and arrest.

Inferred additional harm: Numerous other Black individuals are likely subjected to disproportionate surveillance and false matches that go unreported.

Civil rights

Reported: The report explicitly describes violations of civil rights, false arrest, and false imprisonment.

Directly caused: Nijeer Parks' civil rights were violated through false arrest and false imprisonment, resulting in him being wrongfully jailed for 10 days.

Indirectly caused: The use of unregulated facial recognition technology by law enforcement represents a broader threat to public privacy and civil liberties.

Inferred additional harm: The other two identified individuals, and potentially others, suffered similar violations of their fundamental civil rights due to false matches.

Privacy

Reported: The report explicitly mentions concerns regarding privacy-invading surveillance technology.

Indirectly caused: The scraping of billions of public social media photos by companies like Clearview AI to build facial recognition databases violates general expectations of privacy.

Inferred additional harm: Millions of citizens have had their privacy compromised by having their public photos scraped and analyzed without explicit consent.

Psychological

Reported: The report explicitly describes psychological distress and fear experienced by the victim.

Directly caused: Nijeer Parks experienced severe fear and anxiety, describing the wrongful arrest and the threat of a long prison sentence as 'a very scary ordeal' that 'scared the living heck' out of him.

Indirectly caused: Parks' fiancée and mother experienced significant distress and anxiety as they had to drain their savings to secure his release and legal defense.

Inferred additional harm: The other two Black men mentioned as being wrongfully arrested due to false matches likely suffered similar severe psychological trauma and distress.

People affected

• Occurrences reported: 1
• People reportedly harmed: 3
• People reportedly exposed: 3

Potential causes

Management

• Failure to Enforce Lead-Only Policy: Management failed to ensure FRT was used only as an investigative clue.
• Inadequate Officer Training: Officers were not trained on the limitations and errors of FRT.

Technology

• Algorithmic Demographic Bias: FRT performs poorly on Black faces, leading to false matches.
• Flawed Facial Recognition Matching: The algorithm incorrectly matched Parks to a fake Tennessee license.
• Biased Pretrial Risk Assessment: Risk assessment algorithm kept Parks jailed due to past history.

Data Inputs

• Low-Quality License Photo: The system used a low-quality photo from a fraudulent license.
• Unverified Database Matches: Matches were not validated against physical evidence like fingerprints.

Human Factors

• Confirmation Bias by Detective: Detective agreed with the FRT match without objective verification.
• Erroneous Witness Identification: Hertz employee wrongly confirmed the suspect matched Parks' photo.
• Overreliance on AI Output: Officers treated the algorithmic match as definitive proof of identity.

Process and Methods

• Sole Reliance on FRT for Warrant: Warrant issued based solely on FRT match without corroborating forensics.
• Lack of Forensic Verification: Police failed to check fingerprints or DNA left at the crime scene.
• Inadequate Interrogation Procedures: Interrogators ignored Parks' alibi and lack of driver's license.

Regulatory Environment

• Absence of FRT Regulations: Lack of clear state policies or bans on facial recognition before 2019.
• Lack of Algorithmic Oversight: No regulatory body monitored the accuracy of police facial searches.

Information quality

• Classification confidence: High
• Reason for confidence: The reports provide consistent, detailed accounts of the incident from multiple reputable news sources, detailing the timeline, the victim's experience, and the broader context of facial recognition failures.
• Ambiguities identified: There is some ambiguity regarding the exact software used, as initial claims pointed to Clearview AI, but state agencies denied using it at that time, suggesting a government database system was used instead.

A domestic law enforcement incident where a faulty facial recognition match led to the wrongful arrest and 10-day imprisonment of a Black man in New Jersey. While highlighting critical civil rights and algorithmic bias concerns, the national security impact remains negligible to minor, with no threat to physical infrastructure, sovereignty, or national economic systems.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. Refers to systemic, long-term concerns regarding algorithmic bias and regulation of facial recognition technology in policing.
• Autonomy: Human-controlled. The AI system functioned as an assistant, providing match suggestions that required human verification and decision-making by law enforcement.
• Novelty: Established threat. Facial recognition mismatches and algorithmic bias affecting minority groups are established technical and societal issues with prior precedents.

Impact by dimension

• Physical security: Negligible. No physical security, critical infrastructure, or kinetic systems were impacted or targeted in this domestic law enforcement incident.
• Information security: Negligible. No intelligence compromise, foreign disinformation, or state-sponsored information warfare operations were associated with this incident.
• Sovereignty: Negligible. The incident involved local municipal law enforcement operations and did not threaten national sovereignty, border control, or federal government functions.
• Economic security: Negligible. The financial impact was limited to the victim's personal legal defense costs of approximately $5,000 to $7,500, with no strategic economic threat.
• Societal stability: Minor. The incident represents a clear violation of civil rights and false imprisonment of an individual due to racial bias in AI, but remains a localized law enforcement issue.