Facebook’s "Tag Suggestions" Allegedly Stored Biometric Data without User Consent

Facebook’s initial version of the its Tag Suggestions feature where users were offered suggestions about the identity of people's faces in photos allegedly stored biometric data without consent, violating the Illinois Biometric Information Privacy Act.

Risk classification

• Primary risk domain: 2 Privacy & Security
• Primary risk subdomain: 2.1 Compromise of privacy by obtaining, leaking or correctly inferring sensitive information

The AI system compromised user privacy by obtaining and storing sensitive biometric face templates without explicit user consent.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The privacy risk was caused by Facebook's deliberate managerial decision to deploy the facial recognition feature by default and collect biometric data without user consent.

EU AI Act risk tier

• Risk tier: 2 High Risk

High Risk: The system utilizes facial recognition technology to identify individuals. Under the EU AI Act, biometric identification systems are classified as High Risk due to their significant implications for fundamental rights and privacy.

AI system and alleged parties

• AI system: Tag Suggestions (Meta)
• AI purpose: Face Recognition; Image Tagging
• Behaviour type: Assistant
• Alleged developer: Facebook
• Alleged deployer: Facebook
• Alleged harmed parties: Facebook users

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Severe. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Severe, indirect Severe
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Severe, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Severe, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Financial

Reported: The report explicitly describes a $550 million settlement paid by Facebook to resolve the class-action lawsuit.

Directly caused: Facebook incurred a direct financial loss of $550,000,000 due to the class-action settlement for this single systemic occurrence.

Indirectly caused: The settlement amount also covered the plaintiffs' legal fees as an indirect financial consequence.

Civil rights

Reported: The report explicitly describes violations of civil privacy rights under the Illinois Biometric Information Privacy Act.

Directly caused: Facebook's unauthorized scanning and storage of biometric data directly violated the statutory civil privacy rights of Illinois users.

Inferred additional harm: It is highly likely that millions of users outside Illinois experienced similar violations of their biometric privacy rights, though they lacked equivalent statutory protections.

Privacy

Reported: The report explicitly describes privacy violations concerning the unauthorized collection and storage of biometric data.

Directly caused: Facebook's Tag Suggestions tool scanned users' faces and stored biometric identifiers without their consent, violating their personal data privacy.

Inferred additional harm: Millions of users globally were likely subjected to unauthorized biometric data collection before Facebook transitioned the feature to opt-in only.

People affected

• Occurrences reported: 1
• People reportedly harmed: 1000000
• People reportedly exposed: 1000000

Potential causes

Management

• Slow Policy Shift to Opt-In: Took years to transition the facial recognition platform to opt-in only.

Technology

• Automatic Facial Recognition: Scanned user photos to suggest tags using facial recognition algorithms.
• Biometric Data Storage: Stored biometric templates of users' faces without obtaining proper consent.

Data Inputs

• Unconsented Photo Scanning: Processed biometric details directly from uploaded user photographs.

Human Factors

• Passive User Acceptance: Users left default settings enabled without understanding the privacy impact.

Process and Methods

• Default-On Activation: Enabled facial recognition by default for all users instead of as an opt-in.
• Opaque System Disclosures: Did not transparently explain facial recognition tech to users until 2018.

Regulatory Environment

• BIPA Legal Requirements: Failed to comply with Illinois Biometric Information Privacy Act regulations.

Information quality

• Classification confidence: High
• Reason for confidence: The report provides clear, unambiguous details regarding the legal settlement, the specific AI system involved, the developer, and the nature of the privacy violation.
• Ambiguities identified: The exact number of class members eligible for the settlement is not explicitly stated in the text.
• Alternative interpretations: None.

Facebook settled a class-action lawsuit for 550 million dollars over its Tag Suggestions feature, which collected and stored biometric data of Illinois users without consent. While representing a massive violation of user privacy and civil rights, the national security impact is minor and manageable within standard domestic legal frameworks, posing no immediate threat to physical, sovereign, or intelligence infrastructure.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Facebook

Threat characteristics

• Imminence: Long-term. Represents an ongoing strategic concern regarding biometric data privacy and corporate compliance rather than an active, immediate national security crisis.
• Autonomy: Human-supervised. The AI system automatically scanned faces and generated suggestions, but relied on human confirmation to execute the final tagging action.
• Novelty: Established threat. Biometric data privacy disputes and unauthorized data collection are established issues, although this case set a major financial and legal precedent.

Impact by dimension

• Physical security: Negligible. No physical security threat, kinetic targeting, or critical infrastructure compromise occurred as a result of this consumer-facing facial recognition feature.
• Information security: Minor. Involves the large-scale collection and storage of citizen biometric data, which presents potential surveillance risks but did not involve active intelligence compromise or foreign information warfare.
• Sovereignty: Negligible. The incident did not compromise government decision-making, electoral systems, or state sovereignty functions.
• Economic security: Minor. Resulted in a significant 550 million dollar financial settlement for a major US technology firm, but did not threaten national economic stability or strategic technological advantages.
• Societal stability: Minor. Constitutes a widespread violation of civil privacy rights involving millions of users, though managed and resolved through standard domestic legal and regulatory procedures.