Amnesty International research revealed that the NYPD's use of facial recognition technology disproportionately targets minority communities and protesters in New York City. The study, based on crowdsourced data, found a higher concentration of facial recognition-compatible cameras in neighborhoods with larger non-white populations. The report argues that this pervasive surveillance reinforces discriminatory policing and violates fundamental human rights.
New York Police Department’s use of facial recognition deployment of surveillance cameras were shown using crowdsourced volunteer data reinforcing discriminatory policing against minority communities.
Risk classification
- Primary risk domain: 1 Discrimination & Toxicity
- Primary risk subdomain: 1.1 Unfair discrimination and misrepresentation
The NYPD's deployment of facial recognition technology disproportionately targets non-white neighborhoods, reinforcing discriminatory and racist policing practices against Black and Latinx communities.
Additional risk subdomains
- 4.1 Disinformation, surveillance, and influence at scale: The technology is used for mass surveillance of protesters to track, identify, and deter individuals from exercising their civil rights.
Causal factors
- Entity: Human
- Intent: Intentional
- Timing: Post-deployment
The discriminatory surveillance and privacy violations resulted from the intentional post-deployment decision by the NYPD to concentrate facial recognition-compatible cameras in minority neighborhoods.
EU AI Act risk tier
The report describes a law enforcement application of facial recognition technology, which is explicitly classified as a High Risk (Level 2) system under the provided definitions.
AI system and alleged parties
- AI system: facial recognition technology
- AI purpose: Face Recognition; Smart Surveillance
- Behaviour type: Assistant
- Alleged developer: unknown
- Alleged deployer: New York Police Department
- Alleged harmed parties: racial minorities
Harm severity
Severity ratings are based on this scale.
Highest direct severity in any category: Substantial. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
- Physical: direct Negligible, indirect Negligible
- Infrastructure: direct Negligible, indirect Negligible
- Property: direct Negligible, indirect Negligible
- Financial: direct Negligible, indirect Negligible
- Environmental: direct Negligible, indirect Negligible
- Malicious content: direct Negligible, indirect Negligible
- Differential treatment: direct Minor, indirect Substantial
- Civil rights: direct Substantial, indirect Minor
- Democracy: direct Substantial, indirect Minor
- Privacy: direct Substantial, indirect Negligible
- Psychological: direct Minor, indirect Negligible
- Epistemic: direct Negligible, indirect Negligible
- Child sexual exploitation and abuse: direct Negligible, indirect Negligible
Differential treatment
Reported: Yes
Directly caused: The research showed that the higher the proportion of non-white residents in the Bronx, Brooklyn, and Queens, the higher the concentration of facial recognition-compatible CCTV cameras.
Indirectly caused: The deployment helps to reinforce discriminatory policing and 'digital stop-and-frisk' against minority communities who are already disproportionately targeted.
Inferred additional harm: It is likely that this differential surveillance led to increased rates of wrongful stops, arrests, and systemic bias against Black and Latinx individuals in the targeted areas.
Civil rights
Reported: Yes
Directly caused: The pervasive use of FRT at protest sites is used to identify, track, and harass people who are exercising their human rights to freedom of assembly.
Indirectly caused: The lack of disclosure and refusal to release public records regarding FRT acquisition undermines public accountability and civil oversight.
Inferred additional harm: The chilling effect of mass surveillance likely deterred many more individuals from participating in peaceful protests and exercising their First Amendment rights.
Democracy
Reported: Yes
Directly caused: The NYPD's use of FRT to monitor peaceful Black Lives Matter protests in 2020 directly threatens the democratic right to protest and assemble.
Indirectly caused: The NYPD's refusal to disclose public records regarding its acquisition of surveillance tools undermines democratic transparency and accountability.
Inferred additional harm: The normalization of pervasive, unaccountable police surveillance threatens the long-term health of democratic institutions and civil liberties in municipal governance.
Privacy
Reported: Yes
Directly caused: The NYPD's vast surveillance operation left entire neighborhoods exposed to invasive facial recognition tracking without their consent.
Inferred additional harm: Millions of New York City residents and visitors have likely had their biometric data captured, analyzed, and tracked without their knowledge or explicit consent.
Psychological
Reported: Yes
Directly caused: The report notes that the NYPD uses mass surveillance at protest sites to identify, track, and harass people, which acts as a deliberate scare tactic.
Inferred additional harm: It is highly likely that thousands of protesters and minority residents experienced anxiety, distress, and a sense of intimidation due to being constantly monitored by invasive facial recognition technology.
People affected
- Occurrences reported: 1
- People reportedly harmed: 22000
- People reportedly exposed: 22000
Potential causes
Management
- Prioritizing Mass Surveillance: NYPD management deployed thousands of cameras without human rights guardrails.
- Lack of Transparency and Accountability: Active resistance to public records requests and oversight regarding FRT.
Technology
- Invasive Surveillance Capabilities: FRT allows for pervasive tracking and identification of individuals in public.
- High Density of Argus Cameras: Vast network of compatible CCTV cameras enables total surveillance coverage.
Data Inputs
- Biased Camera Placement Data: Higher concentration of FRT-enabled cameras in non-white neighborhoods.
- Stop-and-Frisk Historical Data: Historical targeting patterns correlate with modern camera deployment.
Human Factors
- Chilling Effect on Protestors: Fear of identification deters citizens from exercising assembly rights.
- Targeting of Minority Communities: Bias in policing tactics leads to disproportionate surveillance of minorities.
Process and Methods
- Digital Stop-and-Frisk Tactics: Using FRT to track, identify, and harass individuals without cause.
- Lack of Public Disclosure: NYPD refused to disclose records regarding acquisition and use of FRT.
Regulatory Environment
- Absence of FRT Ban: Lack of local legislation prohibiting mass surveillance using FRT.
- Weak Oversight on Public Surveillance: No regulatory body effectively monitoring or limiting police FRT use.
Information quality
- Classification confidence: High
- Reason for confidence: The report from Amnesty International is highly detailed, providing specific statistics on camera locations, historical case numbers (22,000 cases), and clear descriptions of the affected communities and geographic areas. The role of the AI system (facial recognition) is explicitly stated, and the harms to privacy, civil rights, and equity are directly documented through spatial analysis and legal actions.
- Ambiguities identified: The specific commercial vendors or developers of the facial recognition software used by the NYPD are not named in the report.
- Alternative interpretations: The NYPD might argue that the camera placement is based on crime rates rather than racial demographics, though the report's statistical analysis controls for stop-and-frisk data.
The NYPD's systematic deployment of facial recognition technology disproportionately targets minority neighborhoods and peaceful protesters in New York City. This pervasive domestic surveillance represents a substantial challenge to societal stability, civil liberties, and democratic norms, highlighting the domestic risks of unregulated AI-enabled policing technologies.
- Overall national security impact: Substantial
- Scope: Single nation
- Primary target: United States
- Alleged perpetrator: New York Police Department
Threat characteristics
- Imminence: Long-term. Represents an ongoing, systemic domestic policing capability and strategic civil rights concern rather than an immediate crisis.
- Autonomy: Human-supervised. The facial recognition system assists law enforcement by providing identification suggestions, requiring human officers to verify and act on the results.
- Novelty: Established threat. The use of facial recognition technology by law enforcement and associated civil rights concerns are established issues with numerous historical precedents.
Impact by dimension
- Physical security: Negligible. No physical attacks, kinetic weapons, or critical infrastructure manipulation were reported in connection with this municipal law enforcement surveillance.
- Information security: Minor. Involves domestic mass surveillance capabilities deployment, but does not involve foreign intelligence compromise or state-sponsored information warfare.
- Sovereignty: Minor. Affects municipal police operations and transparency, but does not threaten overall state authority, territorial control, or core national government functions.
- Economic security: Negligible. No strategic technology theft, financial system attacks, or disruption to national economic and technological security were reported.
- Societal stability: Substantial. Involves systemic mass surveillance and civil liberties violations targeting minority communities and peaceful protesters, impacting social cohesion and constitutional rights in a major metropolis.