ShotSpotter audios were previously admitted to convict an innocent Black man in a murder case in Chicago, resulted in his nearly-one-year-long arrest before being dismissed by prosecutors as insufficient evidence.
ShotSpotter's acoustic gunshot detection system was used by Chicago police as critical evidence in a murder case, leading to the wrongful arrest and year-long incarceration of a 65-year-old man. Investigations revealed that the system frequently misclassifies sounds and that company employees manually modify alerts at the request of police, introducing human bias. The case highlights concerns regarding the lack of transparency, reliability, and potential for racial bias in algorithmic policing tools.
ShotSpotter audios were previously admitted to convict an innocent Black man in a murder case in Chicago, resulted in his nearly-one-year-long arrest before being dismissed by prosecutors as insufficient evidence.
The core failure stems from the AI system's inability to reliably distinguish gunshots from other percussive sounds like fireworks or engine backfires, leading to highly inaccurate alerts.
The incident was primarily caused by the lack of capability and high false-positive rate of the deployed ShotSpotter AI system, which misclassified ambient noises as gunshots.
High Risk: The system is used in law enforcement applications, specifically for crime detection and dispatching, which has significant implications for public safety and fundamental civil rights.
Severity ratings are based on this scale.
Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
Reported: The report explicitly describes physical harm and a fatality indirectly linked to the system's dispatches.
Indirectly caused: Michael Williams developed an uncontrollable physical tremor in his hand during his 11-month incarceration. Additionally, a ShotSpotter alert dispatched police to a scene where they fatally shot 13-year-old Adam Toledo.
Inferred additional harm: Given the high volume of false alerts leading to hostile police deployments, it is highly likely that other individuals suffered physical injuries during wrongful stops or detentions.
Reported: The report explicitly mentions financial losses incurred by the victims of wrongful arrests.
Indirectly caused: Michael Williams suffered a loss of income and incurred significant legal bills due to his 11-month incarceration.
Inferred additional harm: Many of the other individuals stopped or arrested due to the thousands of dead-end deployments likely suffered financial losses from legal fees and missed work.
Reported: The report explicitly describes systemic differential treatment of racial minorities.
Indirectly caused: ShotSpotter sensors were deployed almost exclusively in predominantly Black and Latino neighborhoods, exposing these communities to disproportionate police surveillance and hostile encounters.
Inferred additional harm: Systemic racial bias in law enforcement actions is reinforced by the biased geographic placement of the technology.
Reported: The report explicitly describes widespread violations of civil and constitutional rights.
Indirectly caused: Michael Williams and Daniel Ortiz suffered violations of their Fourth Amendment rights through illegal stops, searches, and arrests without probable cause.
Inferred additional harm: Thousands of Chicago residents stopped during the 40,000+ dead-end deployments likely had their civil liberties and constitutional rights violated.
Reported: The report explicitly describes privacy violations through surveillance and illegal searches.
Indirectly caused: The continuous acoustic monitoring of neighborhoods without resident consent, and the illegal search of Daniel Ortiz's vehicle by responding officers.
Inferred additional harm: Continuous acoustic surveillance of millions of residents in covered areas without public oversight or consent.
Reported: The report explicitly describes severe psychological distress and mental health struggles resulting from wrongful incarceration.
Indirectly caused: Michael Williams suffered severe mental anguish, trauma, and suicidal ideation, planning to take his life with stockpiled pills during his 11-month wrongful imprisonment.
Inferred additional harm: Other individuals subjected to arbitrary arrests and aggressive detentions, such as Daniel Ortiz, likely experienced significant psychological trauma and distress.
Reported: The report explicitly describes the creation of false or altered forensic evidence.
Directly caused: ShotSpotter generated altered forensic reports that misrepresented the nature and location of sounds.
Indirectly caused: Prosecutors introduced these altered reports as scientific evidence in court trials, undermining the integrity of the judicial process.
Inferred additional harm: Numerous other criminal cases may have been compromised by altered or fabricated ShotSpotter evidence that went unchallenged.
The failure of ShotSpotter's acoustic gunshot detection system in Chicago led to a wrongful arrest and highlighted systemic issues with algorithmic policing tools. While causing localized civil liberties and human rights concerns, the incident has minor implications for national security.