.avif){kind=small}
Police departments across the U.S. have utilized Clearview AI's facial recognition software to identify criminal suspects, frequently failing to disclose this usage to defendants. This practice has led to multiple wrongful arrests, particularly affecting people of color, and has raised significant concerns regarding due process, transparency, and the reliability of the technology in law enforcement.
Police departments across the U.S. have used facial recognition software to identify suspects in criminal investigations, leading to multiple false arrests and wrongful detentions. The software's unreliability, especially in identifying people of color, has resulted in misidentifications that were not disclosed to defendants. In some cases, individuals were unaware that facial recognition played a role in their arrest, violating their legal rights and leading to unjust detentions.
The facial recognition technology exhibits unequal performance across demographic groups, with significantly higher false match rates for people of color, directly leading to the wrongful arrest of Black individuals like Quran Williams.
The incident was initiated by a false match generated by the Clearview AI system post-deployment, which was an unintentional and unexpected outcome of the system's use.
High Risk: The report describes the use of facial recognition technology in law enforcement, which is explicitly classified as a High Risk application under the EU AI Act due to its significant implications for safety and fundamental rights.
Severity ratings are based on this scale.
Highest direct severity in any category: Severe. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
Reported: Yes, the report describes a $200,000 settlement paid to Quran Williams, and mentions thefts of thousands of dollars, though the thefts themselves were not caused by the AI.
Directly caused: The Jefferson Parish Sheriff's Office paid a $200,000 settlement to Quran Williams to resolve his civil rights lawsuit over the false arrest.
Indirectly caused: Defendants likely incurred significant legal fees to defend themselves against wrongful charges stemming from false AI matches.
Inferred additional harm: Across the hundreds of cases involving undisclosed facial recognition arrests, millions of dollars in legal fees, lost wages during incarceration, and public settlement payouts were likely incurred.
Reported: Yes, the report explicitly describes how facial recognition technology disproportionately misidentifies people of color, leading to biased law enforcement outcomes.
Directly caused: Quran Williams and at least five other Black individuals were wrongly arrested due to false matches, reflecting the technology's higher error rates for people of color.
Indirectly caused: The systemic use of biased facial recognition software by police departments disproportionately subjects marginalized communities to wrongful surveillance and arrests.
Inferred additional harm: A significant portion of the hundreds of individuals arrested using this technology likely faced discriminatory outcomes due to the documented racial bias in the algorithms.
Reported: Yes, the report explicitly describes violations of civil rights, false arrests, and denial of due process.
Directly caused: Quran Williams' constitutional rights were violated through false arrest and malicious prosecution based solely on an unverified AI match.
Indirectly caused: Hundreds of defendants were denied their due process rights because police departments systematically hid the use of facial recognition technology, preventing them from challenging the evidence.
Inferred additional harm: It is highly likely that thousands of individuals have had their civil liberties and due process rights compromised across the U.S. due to undisclosed police reliance on facial recognition.
Reported: Yes, the report mentions concerns from privacy advocates regarding Clearview AI's scraping of billions of images from social media and public websites.
Directly caused: Clearview AI scraped billions of images of individuals from social media and public websites without their consent to build its database.
Indirectly caused: The use of real-time facial recognition networks, like Project NOLA, subjects the general public to ongoing biometric surveillance.
Inferred additional harm: Millions of citizens have had their biometric privacy violated through the unauthorized scraping and indexing of their faces in commercial law enforcement databases.
Reported: Yes, the report explicitly describes psychological distress and trauma caused directly and indirectly by the incident.
Directly caused: Quran Williams suffered emotional distress and trauma due to being wrongly jailed for six days based on a false AI match.
Indirectly caused: Other misidentified individuals, such as Francisco Arteaga who spent four years in jail, likely suffered severe psychological distress and trauma.
Inferred additional harm: It is highly likely that many of the hundreds of other individuals arrested due to undisclosed facial recognition matches experienced significant anxiety, distress, and trauma from wrongful incarceration.
Reported: Yes, the report describes police officers obscuring their reliance on AI by writing false or misleading statements in official arrest warrants and affidavits.
Directly caused: A JPSO detective submitted a sworn affidavit falsely claiming a 'credible source' had identified Quran Williams, omitting the use of facial recognition.
Indirectly caused: Police departments routinely obscured their use of the software in public-facing reports, claiming identifications were made through 'investigative means' or human sources, thereby polluting the legal record.
Inferred additional harm: The systematic falsification or omission of AI usage in police reports across hundreds of cases undermines the integrity of the judicial system and the accuracy of public legal records.
Widespread and undisclosed use of Clearview AI facial recognition software by U.S. police departments has led to wrongful arrests and systemic violations of civil rights and due process, particularly affecting people of color. While not a direct kinetic threat, the practice undermines judicial integrity, public trust, and constitutional protections on a substantial scale.