During an immigration enforcement operation in Oregon, ICE and CBP officers used the Mobile Fortify facial recognition app to identify a detained woman. The system returned two different and incorrect identities for the same individual. This incident highlights concerns regarding the reliability of the app, which officials have claimed provides a 'definitive' determination of immigration status, potentially leading to wrongful detention.
During an immigration enforcement operation in Oregon, U.S. Immigration and Customs Enforcement (ICE) officers reportedly used the facial recognition application Mobile Fortify to identify a detained woman. The system reportedly returned two different and incorrect identities for the same individual across separate scans.
Risk classification
- Primary risk domain: 1 Discrimination & Toxicity
- Primary risk subdomain: 1.3 Unequal performance across groups
The incident involves a facial recognition system failing to correctly identify a woman of color, highlighting documented systemic performance disparities of biometric technology across demographic groups.
Additional risk subdomains
- 5.1 Overreliance and unsafe use: ICE officers rely on the app as a 'definitive' determination of status, even ignoring physical evidence like birth certificates.
- 7.3 Lack of capability or robustness: The AI system failed to perform reliably, returning two completely different and incorrect names for the same individual.
Causal factors
- Entity: AI
- Intent: Unintentional
- Timing: Post-deployment
The incident was caused by the Mobile Fortify AI system returning incorrect identification results, which was an unexpected and unintentional outcome of its deployment.
EU AI Act risk tier
Risk Level 2: High Risk. The system is a facial recognition application used by law enforcement (ICE and CBP) to identify individuals and determine immigration status, which falls directly under 'Law enforcement applications, including facial recognition'.
AI system and alleged parties
- AI system: None named
- AI purpose: Face Recognition; Identification
- Behaviour type: Assistant
- Alleged developer: United States Department of Homeland Security
- Alleged deployer: United States Immigration and Customs Enforcement, United States Customs and Border Protection
- Alleged harmed parties: Unnamed woman detained by United States Immigration and Customs Enforcement, Individuals subject to immigration enforcement
Harm severity
Severity ratings are based on this scale.
Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
- Physical: direct Negligible, indirect Negligible
- Infrastructure: direct Negligible, indirect Negligible
- Property: direct Negligible, indirect Negligible
- Financial: direct Negligible, indirect Negligible
- Environmental: direct Negligible, indirect Negligible
- Malicious content: direct Negligible, indirect Negligible
- Differential treatment: direct Minor, indirect Minor
- Civil rights: direct Minor, indirect Minor
- Democracy: direct Negligible, indirect Negligible
- Privacy: direct Minor, indirect Minor
- Psychological: direct Negligible, indirect Negligible
- Epistemic: direct Negligible, indirect Negligible
- Child sexual exploitation and abuse: direct Negligible, indirect Negligible
Differential treatment
Reported: The report explicitly discusses how facial recognition technology disproportionately misidentifies and negatively impacts people of color.
Directly caused: The victim, a woman of color, was misidentified by the app, leading to wrongful interrogation under false names.
Indirectly caused: The deployment of an error-prone biometric tool that performs poorly on women of color leads to systemic differential treatment in law enforcement operations.
Inferred additional harm: Other minority individuals scanned by ICE are highly likely to experience similar misidentifications and subsequent discriminatory enforcement actions.
Civil rights
Reported: The report explicitly describes violations of civil and constitutional rights.
Directly caused: The victim's rights were violated through wrongful detention and forced biometric scanning without consent.
Indirectly caused: The reliance on a flawed app to make 'definitive' immigration status determinations undermines due process and constitutional protections.
Inferred additional harm: Numerous other individuals may have had their civil rights violated or faced wrongful deportation due to the app's incorrect determinations.
Privacy
Reported: The report explicitly describes biometric privacy violations.
Directly caused: The victim was subjected to non-consensual biometric facial scanning using a mobile device.
Indirectly caused: The deployment of Mobile Fortify turns border surveillance capabilities inward onto American streets, compromising public privacy expectations.
Inferred additional harm: Thousands of individuals scanned by ICE and CBP nationwide have had their biometric privacy compromised without their consent.
People affected
- Occurrences reported: 1
- People reportedly harmed: 1
- People reportedly exposed: 1
Potential causes
Management
- Overstating App Capabilities: Management claimed the app is 'definitive' and superior to birth certificates.
- Inadequate Operator Training: Officers were not trained on the app's error rates or limitations.
Technology
- Facial Recognition Inaccuracy: The technology is inherently error-prone, especially for women of color.
- Inconsistent Matching Algorithm: The app returned two different incorrect names for the same individual.
Data Inputs
- Poor Image Capture Quality: Subject was looking down and handcuffed, leading to a poor quality photo.
- Database Matching Errors: System matched the photo to incorrect profiles in the CBP database.
Human Factors
- Automation Bias: Officers treated the app as 100% accurate and definitive.
- Coercive Physical Force: Officer physically forced the detainee to capture the image.
- Confirmation Bias: Agents called out incorrect names to see if the detainee would respond.
Process and Methods
- No Option to Decline Scan: Policies prevent individuals from declining facial recognition scans.
- Lack of Verification Protocols: No process to verify app results against physical documents in the field.
Regulatory Environment
- Absence of Facial Recognition Laws: Lack of federal regulations governing the use of biometric apps.
- Lack of Oversight and Accountability: No independent oversight to monitor the app's error rates and usage.
Information quality
- Classification confidence: High
- Reason for confidence: The report provides clear, detailed testimony from a CBP official and statements from legal representatives regarding a specific, well-documented incident of facial recognition failure. The role of the Mobile Fortify app is explicitly stated, and the resulting harms (wrongful interrogation, physical discomfort, and civil rights concerns) are clearly outlined.
- Ambiguities identified: The exact technical reasons for the app's failure to correctly identify the woman are not fully detailed, and the exact number of other individuals affected nationwide is not quantified.
- Alternative interpretations: None. The incident is a straightforward case of facial recognition misidentification during law enforcement operations.
An immigration enforcement incident in Oregon where a flawed facial recognition app (Mobile Fortify) misidentified a detained woman, leading to wrongful detention and civil rights concerns. While highlighting issues of algorithmic bias and overreliance on technology within domestic agencies, the incident represents a minor national security impact limited to local enforcement operations.
- Overall national security impact: Minor
- Scope: Single nation
- Primary target: United States
- Alleged perpetrator: Unknown
Threat characteristics
- Imminence: Long-term. Represents an ongoing strategic concern regarding the domestic deployment of biometric surveillance rather than an active crisis.
- Autonomy: Human-controlled. The facial recognition app acts as an assistant, with human officers retaining final decision-making authority for detentions.
- Novelty: Established threat. Misidentification and demographic bias in facial recognition technology are well-documented, established issues in law enforcement.
Impact by dimension
- Physical security: Negligible. Minor physical pain reported during arrest but no threat to physical systems, critical infrastructure, or national physical security.
- Information security: Negligible. No evidence of intelligence compromise, classified data theft, or information warfare operations.
- Sovereignty: Minor. Flawed AI tool impacted domestic immigration enforcement procedures and led to wrongful detention, but did not threaten overall state authority or sovereignty.
- Economic security: Negligible. No significant threat to strategic industries, financial systems, or national technological competitive advantage.
- Societal stability: Minor. Individual civil rights violation and wrongful detention due to biometric misidentification, but limited to a single documented domestic incident without population-scale disruption.