A medical student in Paraguay was falsely accused of theft and expelled from a supermarket after the store's facial recognition system incorrectly flagged him as a 90% match to a suspect.
At a Biggie Express convenience store in San Lorenzo, Paraguay, medical student Pablo Servín said employees publicly accused him of theft and refused service after a facial-recognition system reportedly matched him to a robbery suspect with 90% similarity. He said a subsequent review of security footage showed he was not the suspect. Servín described humiliation and questioned the chain's handling of biometric data. The system's developer was not identified.
Risk classification
- Primary risk domain: 7 AI system safety, failures, & limitations
- Primary risk subdomain: 7.3 Lack of capability or robustness
The facial recognition system failed to perform reliably, generating a false positive match of 90% between two different individuals with similar features.
Additional risk subdomains
- 5.1 Overreliance and unsafe use: Supermarket employees blindly trusted the AI's 'thief' label and took immediate action without performing any manual verification.
- 2.1 Compromise of privacy by obtaining, leaking or correctly inferring sensitive information: The supermarket chain collected and processed sensitive biometric data of customers without explicit consent or transparent terms of treatment.
Causal factors
- Entity: AI
- Intent: Unintentional
- Timing: Post-deployment
The incident was triggered by a false positive match generated by the deployed facial recognition AI system, which was an unexpected outcome of its operation.
EU AI Act risk tier
High Risk: The report describes a facial recognition system used for identification in a public commercial space, which falls under law enforcement and biometric identification applications that have significant implications for fundamental rights.
AI system and alleged parties
- AI system: facial-recognition system
- AI purpose: Face Recognition; Smart Surveillance
- Behaviour type: Tool
- Alleged developer: Surveillance technology developers, Facial recognition system developers
- Alleged deployer: Facial recognition system deployers, Businesses using biometrics, Biggie Express
- Alleged harmed parties: Shoppers, Privacy, People misidentified by facial recognition systems, Pablo Servín, Epistemic integrity, Customers, Consumers, Biometric data subjects
Harm severity
Severity ratings are based on this scale.
Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
- Physical: direct Negligible, indirect Negligible
- Infrastructure: direct Negligible, indirect Negligible
- Property: direct Negligible, indirect Negligible
- Financial: direct Negligible, indirect Negligible
- Environmental: direct Negligible, indirect Negligible
- Malicious content: direct Negligible, indirect Negligible
- Differential treatment: direct Minor, indirect Negligible
- Civil rights: direct Minor, indirect Negligible
- Democracy: direct Negligible, indirect Negligible
- Privacy: direct Minor, indirect Negligible
- Psychological: direct Minor, indirect Negligible
- Epistemic: direct Negligible, indirect Negligible
- Child sexual exploitation and abuse: direct Negligible, indirect Negligible
Differential treatment
Reported: Yes, the victim was singled out, denied service, and expelled from the store based on the false AI match.
Directly caused: Servin was barred from entering the store and denied service based on the AI's false identification.
Inferred additional harm: Other customers falsely flagged by the system would also face denial of service and differential treatment.
Civil rights
Reported: Yes, the report describes concerns regarding the violation of personal data protection rights and dignity.
Directly caused: Servin's right to dignity and protection of personal data was violated when he was falsely accused and his biometric data was processed without clear consent.
Inferred additional harm: The biometric data of thousands of customers is being collected and processed without proper consent or transparency, violating their civil rights.
Privacy
Reported: Yes, the report explicitly discusses the unauthorized collection and processing of biometric data.
Directly caused: Servin's biometric data was collected, stored, and matched without his explicit consent or clear terms of treatment.
Inferred additional harm: The privacy of all customers entering the store is compromised by the ongoing unauthorized biometric surveillance.
Psychological
Reported: Yes, the report explicitly describes psychological distress and public humiliation experienced by the victim.
Directly caused: Servin experienced severe public embarrassment and shock ('La verguenza que pase frente a la gente no se me borra nunca', 'quede en shock') after being falsely accused and expelled.
Inferred additional harm: Other individuals who contacted Servin claiming to have experienced similar situations likely suffered similar public humiliation and distress.
People affected
- Occurrences reported: 1
- People reportedly harmed: 1
- People reportedly exposed: 1
Potential causes
Management
- Prioritizing Security Over Rights: Management deployed biometric tracking without establishing safeguards.
- Lack of Staff Training: Employees were not trained on facial recognition limitations or bias.
- Failure to Apologize or Correct: Management did not issue an apology or explain data usage after the error.
Technology
- Facial Recognition False Positive: System returned a 90% match for a person with similar facial features.
- Lack of System Verification Tools: The system lacked automated secondary validation or cross-checks.
Data Inputs
- Poor Database Metadata: Suspect profile only contained an image and the generic name 'ladron'.
- Unverified Biometric Database: Database populated with biometric templates without verifying real identities.
Human Factors
- Automation Bias by Staff: Employees blindly trusted the system match without questioning the result.
- Lack of Empathy and Protocol: Staff confrontational behavior humiliated the customer without hearing defense.
Process and Methods
- No Human Verification Process: Store failed to compare live customer with suspect footage before action.
- Inadequate Incident Response: No formal protocol for handling system flags or customer disputes.
Regulatory Environment
- Weak Biometric Data Regulations: Lack of strict enforcement of Law 6534 regarding biometric data.
- Absence of Mass Surveillance Laws: No clear legal framework or public debate on private mass surveillance use.
Information quality
- Classification confidence: High
- Reason for confidence: The reports provide clear and consistent details about the incident involving Servin, the technology used (facial recognition), the error rate (90% match), and the social/legal reactions in Paraguay.
- Ambiguities identified: The specific developer of the facial recognition software is not named.
A facial recognition false positive at a Paraguayan supermarket led to the false accusation and expulsion of a medical student. While the incident has negligible direct national security implications, it has sparked public outrage and highlighted societal concerns regarding unregulated biometric surveillance and personal data protection in Paraguay.
- Overall national security impact: Minor
- Scope: Single nation
- Primary target: Paraguay
- Alleged perpetrator: Biggie Express
Threat characteristics
- Imminence: Long-term. Reflects a gradual regulatory and societal challenge regarding biometric data use rather than an active national security crisis.
- Autonomy: Human-supervised. The facial recognition system automatically matched and flagged the individual, though store employees executed the final action.
- Novelty: Established threat. False positives in facial recognition systems are a well-documented technical limitation globally.
Impact by dimension
- Physical security: Negligible. No physical threats, kinetic attacks, or critical infrastructure disruptions occurred during this commercial retail incident.
- Information security: Negligible. The incident does not involve information warfare, intelligence compromise, or state-sponsored disinformation.
- Sovereignty: Negligible. No threat to state authority, territorial control, or core government operations was observed.
- Economic security: Negligible. The event was restricted to an individual retail dispute and does not impact strategic industries or national economic security.
- Societal stability: Minor. The incident highlights civil rights and privacy concerns regarding unregulated biometric surveillance, sparking public outrage and demands for data protection laws in Paraguay.