Cross-Jurisdictional Facial Recognition Misidentification by NYPD Leads to Wrongful Arrest and Four-Year Jail Time in New Jersey

In 2019, facial recognition technology misidentified Francisco Arteaga as a suspect in an armed robbery in New Jersey. The incident led to nearly four years of pretrial incarceration. Despite having an alibi, Arteaga was charged based on the flawed identification. The legal battle that followed resulted in a court ruling requiring police to reveal details about the algorithms used in facial recognition. The process exposed significant gaps in transparency and accountability.

Risk classification

• Primary risk domain: 7 AI system safety, failures, & limitations
• Primary risk subdomain: 7.3 Lack of capability or robustness

The AI system failed to perform reliably by generating a false positive match from grainy surveillance footage, leading to the wrongful arrest of an innocent person.

Additional risk subdomains

• 7.4 Lack of transparency or interpretability: The proprietary nature of the AI software and lack of cross-jurisdictional transparency prevented the defendant from accessing the system's source code and error rates for his defense.
• 5.1 Overreliance and unsafe use: Law enforcement officers over-relied on a single 'possible match' from the AI system to arrest and charge the suspect despite a lack of supporting evidence.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The incident was initiated by an incorrect match generated by the Clearview AI facial recognition system after its deployment, leading to a wrongful arrest.

EU AI Act risk tier

• Risk tier: 2 High Risk

High Risk (Level 2): The report describes the use of facial recognition technology by law enforcement to identify criminal suspects, which is explicitly classified as a High-Risk AI application under the EU AI Act.

AI system and alleged parties

• AI system: Clearview AI, facial recognition software (Clearview AI)
• AI purpose: Face Recognition; Identification
• Behaviour type: Assistant
• Alleged developer: Clearview AI
• Alleged deployer: West New York PD, Real Time Crime Center, NYPD
• Alleged harmed parties: Francisco Arteaga

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Minor
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Minor, indirect Negligible
• Civil rights: direct Negligible, indirect Minor
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Minor
• Psychological: direct Negligible, indirect Minor
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Financial

Reported: Yes, the report describes the robbery of $8,950, but this was the crime itself, not a loss caused by the AI. However, [PERSON_001] suffered financial harm due to incarceration and legal defense, though specific amounts are not detailed.

Indirectly caused: [PERSON_001] likely suffered significant loss of income and incurred legal defense costs during his four years of pretrial detention, though the exact financial figures are not specified in the report.

Inferred additional harm: It is highly likely that [PERSON_001] suffered tens of thousands of dollars in lost wages and legal fees due to his wrongful arrest and four-year detention.

Differential treatment

Reported: Yes, the report describes how [PERSON_001] was singled out and targeted as a suspect based on a flawed AI match.

Directly caused: The Clearview AI system generated a false match identifying [PERSON_001] as the suspect, leading to him being singled out and arrested.

Civil rights

Reported: Yes, the report explicitly describes violations of due process and civil rights.

Indirectly caused: [PERSON_001]'s constitutional right to due process was violated when he was imprisoned for nearly four years and denied access to the proprietary AI evidence used to charge him, ultimately forcing him to plead guilty.

Inferred additional harm: Other defendants identified by proprietary facial recognition tools likely face similar due process violations due to non-disclosure agreements and lack of cross-jurisdictional discovery.

Privacy

Reported: Yes, the report mentions the use of Clearview AI, which compiles mugshot databases and surveillance data.

Indirectly caused: The NYPD Real Time Crime Center compared surveillance footage against databases containing [PERSON_001]'s mugshot from years prior to generate the match.

Inferred additional harm: Clearview AI's scraping and compilation of millions of images without consent represents a widespread, ongoing violation of privacy rights for many individuals whose data is stored in their databases.

Psychological

Reported: Yes, the report explicitly describes psychological distress and suffering experienced by [PERSON_001] and his family due to his four-year incarceration.

Indirectly caused: [PERSON_001] experienced significant emotional distress and felt like a 'hostage' during his nearly four years in pretrial detention, and noted that his children and fiancee were also hurting.

Inferred additional harm: It is highly likely that [PERSON_001] suffered long-term psychological trauma, anxiety, and institutionalization stress from being wrongfully imprisoned for nearly four years.

People affected

• Occurrences reported: 1
• People reportedly harmed: 1
• People reportedly exposed: 1

Potential causes

Management

• No Tracking of FRT Usage: The Attorney General's office did not monitor how many agencies used FRT.
• Lack of Accountability Framework: Management failed to establish controls and safeguards before adopting FRT.

Technology

• Flawed FRT Algorithms: Facial recognition software produced a false match from grainy footage.
• Proprietary Software Secrecy: Developers require NDAs, preventing algorithmic transparency.

Data Inputs

• Low Quality Surveillance Footage: Grainy images from store cameras increased the likelihood of a false match.
• Historical Mugshot Databases: System matched suspect to old mugshots for unrelated past offenses.

Human Factors

• Automation Bias: Police accepted a 'possible match' as definitive proof to arrest.
• Confirmation Bias: Witnesses confirmed the suspect after being shown a biased photo array.

Process and Methods

• Unregulated Out-of-State Searches: NJ police bypassed local protocols by using NYPD's database.
• Withholding Technical Discovery: Prosecutors failed to provide algorithm details, violating due process.

Regulatory Environment

• Lack of FRT Governance: No clear statewide or federal laws regulate law enforcement use of FRT.
• Interstate Cooperation Gaps: Cross-jurisdictional use allowed agencies to evade local discovery rulings.

Information quality

• Classification confidence: High
• Reason for confidence: The report provides a highly detailed, legally documented account of [PERSON_001]'s arrest, the appellate court proceedings, and the specific role of facial recognition technology (Clearview AI) in his identification. The facts regarding his detention, the lack of discovery, and the systemic issues are clear and uncontradicted.
• Ambiguities identified: The exact technical parameters and error rates of the specific Clearview AI search used in this case remain unknown due to the proprietary nature of the software and lack of discovery.
• Alternative interpretations: None. The causal link between the AI's false match and the subsequent wrongful arrest is clear and undisputed by the parties involved.

A domestic law enforcement incident in which a false positive match from Clearview AI facial recognition software led to the wrongful arrest and four-year detention of an individual. While highlighting critical civil rights, privacy, and judicial transparency concerns regarding police use of proprietary AI, the incident has minor direct national security implications.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. Represents an ongoing strategic concern regarding domestic surveillance policy rather than an active, immediate national security crisis.
• Autonomy: Human-supervised. The AI system acted as an assistant to suggest possible matches, but human law enforcement officers made the final arrest and prosecution decisions.
• Novelty: Evolved capability. While database matching errors are established, using massive, scraped commercial facial recognition databases like Clearview AI without oversight represents an evolved capability threat to civil liberties.

Impact by dimension

• Physical security: Negligible. No physical security threats or critical infrastructure disruptions occurred during this incident.
• Information security: Negligible. No information warfare, deepfake campaigns, or intelligence security compromises were associated with this domestic law enforcement incident.
• Sovereignty: Negligible. The incident involved domestic law enforcement and judicial processes, representing a localized failure rather than a threat to national sovereignty or core federal government functions.
• Economic security: Negligible. There was no impact on strategic industries, financial systems, or the nation's technological competitive advantage.
• Societal stability: Minor. The wrongful arrest due to a false facial recognition match highlights domestic civil rights, due process, and privacy concerns regarding law enforcement surveillance, but represents a minor threat to overall national societal stability.