YouTube Recommendation Reportedly Pushed Election Fraud Content to Skeptics Disproportionately

A study by NYU researchers found that YouTube's recommendation algorithm disproportionately suggested election fraud-related content to users who were already skeptical of the 2020 US presidential election's legitimacy. By controlling user navigation in an experiment, researchers observed that skeptical users were shown three times as many election-fraud videos as less skeptical users. The findings highlight the potential for recommendation systems to amplify misinformation by catering to user predispositions, contributing to polarized information environments.

YouTube's recommendation algorithm allegedly pushed 2020's US Presidential Election fraud content to users most skeptical of the election's legitimacy disproportionately compared to least skeptical users.

Source: AI Incident Database

Risk classification

  • Primary risk domain: 3 Misinformation
  • Primary risk subdomain: 3.2 Pollution of information ecosystem and loss of consensus reality

The YouTube recommendation algorithm created personalized filter bubbles by disproportionately feeding election fraud content to skeptical users, thereby polluting the information ecosystem and weakening social cohesion.

Causal factors

  • Entity: AI
  • Intent: Unintentional
  • Timing: Post-deployment

The amplification of election fraud content was driven by the post-deployment operations of YouTube's recommendation algorithm, which unintentionally optimized for user engagement by feeding skeptical users conspiracy theories.

EU AI Act risk tier

  • Risk tier: 1 Unacceptable

Unacceptable Risk: The report describes an AI system used for behavioral influence and manipulation (polarization and filter bubbles) that led to real-world harm, including the January 6th Capitol attack and threats to democratic institutions.

AI system and alleged parties

  • AI system: YouTube recommendation algorithm (Google)
  • AI purpose: Content Recommendation; Automated Content Curation
  • Behaviour type: Autonomous
  • Alleged developer: YouTube
  • Alleged deployer: YouTube
  • Alleged harmed parties: YouTube users skeptical of US election results

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

  • Physical: direct Negligible, indirect Substantial
  • Infrastructure: direct Negligible, indirect Minor
  • Property: direct Negligible, indirect Substantial
  • Financial: direct Negligible, indirect Negligible
  • Environmental: direct Negligible, indirect Negligible
  • Malicious content: direct Minor, indirect Substantial
  • Differential treatment: direct Minor, indirect Minor
  • Civil rights: direct Negligible, indirect Minor
  • Democracy: direct Minor, indirect Substantial
  • Privacy: direct Negligible, indirect Negligible
  • Psychological: direct Negligible, indirect Minor
  • Epistemic: direct Minor, indirect Substantial
  • Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Physical

Reported: The report explicitly mentions the January 6th attack on the Capitol and terroristic death threats to election officials, which are indirect physical harms linked to the proliferation of these narratives.

Indirectly caused: The report notes that election fraud narratives contributed to the historic January 6th attack on the Capitol and led to Trump supporters making terroristic death threats against election officials throughout 2021.

Inferred additional harm: It is likely that additional physical injuries occurred during the January 6th Capitol attack (which resulted in multiple injuries and deaths) and that election officials experienced physical security threats, though specific casualty numbers are not fully detailed in the text.

Infrastructure

Reported: The report mentions the attack on the US Capitol, which involved physical damage to the building.

Indirectly caused: The January 6th attack on the Capitol, fueled by election fraud narratives, resulted in physical damage to the Capitol building.

Property

Reported: The report mentions the attack on the US Capitol, which involved damage to public property.

Indirectly caused: The Capitol building and surrounding property suffered damage during the January 6th attack.

Malicious content

Reported: The report explicitly describes the spread of election fraud claims, conspiracy theories, and terroristic death threats.

Directly caused: The YouTube algorithm directly recommended election fraud-related videos to skeptical users at three times the rate of non-skeptical users.

Indirectly caused: The proliferation of these narratives online led to the creation and spread of further conspiracy theories and terroristic death threats against election officials.

Inferred additional harm: It is highly likely that millions of other toxic or malicious comments and videos were generated and recommended across the platform during this period.

Differential treatment

Reported: The report describes the algorithm treating users differently based on their political skepticism.

Directly caused: The algorithm disproportionately targeted users who were skeptical of the election's legitimacy, recommending them three times as many election-fraud videos.

Indirectly caused: This differential recommendation pattern reinforced echo chambers and polarized specific groups of voters.

Civil rights

Reported: The report does not explicitly describe violations of human or civil rights, though it mentions threats to election officials.

Indirectly caused: The terroristic death threats against election officials violated their civil right to work and live free from targeted harassment and intimidation.

Democracy

Reported: The report explicitly describes the erosion of democratic norms and challenges to America's democratic institutions.

Directly caused: The algorithm's recommendation patterns contributed to a polarized information environment, undermining shared consensus reality.

Indirectly caused: The proliferation of these conspiracy theories led to the January 6th Capitol attack, representing one of the greatest challenges to democratic institutions in over a century, and threatened the peaceful transfer of power.

Inferred additional harm: The long-term trust in democratic elections among millions of citizens was likely severely eroded, though this cannot be fully quantified.

Psychological

Reported: The report describes the psychological impact of terroristic death threats against election officials.

Indirectly caused: Election officials experienced severe distress and anxiety due to receiving terroristic death threats from individuals influenced by election fraud narratives.

Inferred additional harm: Widespread anxiety, distress, and political polarization likely affected millions of citizens exposed to intense conspiracy theories, though this is not quantified.

Epistemic

Reported: The report explicitly describes the spread of misinformation, disinformation, and conspiracy theories regarding the 2020 election.

Directly caused: The algorithm directly amplified false claims of widespread election fraud by disproportionately recommending them to susceptible users.

Indirectly caused: This amplification led to widespread belief in false narratives, undermining the shared consensus reality of the election's legitimacy.

Inferred additional harm: Millions of users likely developed deeply held false beliefs about the election outcome due to the algorithm's feedback loops.

People affected

  • Occurrences reported: 1
  • People reportedly harmed: 300
  • People reportedly exposed: 300

Potential causes

Management

  • Prioritizing Engagement over Safety: Management optimized systems to give users the polarizing content they wanted.
  • Defensive Stance on Audits: YouTube management disputed independent findings instead of collaborating.

Technology

  • Engagement-Driven Algorithm: Algorithm optimizes for user watch time and engagement, feeding user biases.
  • Black-Box Recommendation System: Proprietary algorithm hides how watch history and demographics are weighted.

Data Inputs

  • Skeptical User Watch History: Algorithm uses past watch history to recommend similar election fraud content.
  • Unfiltered Prominent Sources: Videos from Fox News and the White House were treated as standard input data.

Human Factors

  • Pre-existing User Skepticism: Users predisposed to believe conspiracy theories actively engaged with them.
  • Confirmation Bias: Users prefer content that aligns with their beliefs, driving algorithm loops.

Process and Methods

  • Delayed Content Moderation: YouTube did not remove election fraud videos until December 2020.
  • Restricted Research Data Sharing: YouTube limits external audits of its live recommendation systems.

Regulatory Environment

  • Lack of Algorithm Transparency Rules: No regulations force platforms to open recommendation engines to public audit.

Information quality

  • Classification confidence: High
  • Reason for confidence: The reports provide clear details on the study's methodology, sample size (over 300 participants), and findings (3x amplification). While YouTube disputes the findings, the academic study's parameters are well-documented, allowing for a high-confidence assessment of the algorithm's role in spreading misinformation.
  • Ambiguities identified: YouTube's algorithm is a black box, so the exact internal mechanisms (whether it uses watch history, demographics, or both) remain unverified. Additionally, YouTube disputes the study's representativeness and data completeness.
  • Alternative interpretations: YouTube suggests that user preferences and active subscriptions, rather than the recommendation algorithm itself, are primarily responsible for steering users toward extreme content.

YouTube's recommendation algorithm autonomously amplified election fraud misinformation to skeptical users during the 2020 US Presidential Election. This disproportionate curation contributed to a polarized information environment, undermined trust in democratic processes, and indirectly fueled societal instability, culminating in the January 6th Capitol attack.

  • Overall national security impact: Substantial
  • Scope: Single nation
  • Primary target: United States
  • Alleged perpetrator: Unknown

Threat characteristics

  • Imminence: Long-term. Represents an ongoing, systemic strategic concern regarding algorithmic polarization rather than an active, immediate crisis.
  • Autonomy: Full autonomy. The recommendation engine autonomously selects, ranks, and serves content to millions of users in real time without human intervention.
  • Novelty: Evolved capability. Represents a significant, highly scaled evolution of algorithmic polarization targeting a pivotal democratic event.

Impact by dimension

  • Physical security: Minor. Indirect connection to physical violence and security threats, specifically the January 6th Capitol attack and death threats to election officials, though the AI did not directly control kinetic systems.
  • Information security: Substantial. The algorithm amplified election-related misinformation, contributing to a highly polarized information environment and undermining public trust during a critical democratic event.
  • Sovereignty: Substantial. The amplification of conspiracy theories challenged the peaceful transfer of power and compromised public confidence in the core electoral processes of the nation.
  • Economic security: Negligible. No direct or significant threats to economic stability, financial systems, or strategic technological competitive advantage were identified.
  • Societal stability: Substantial. The system drove large-scale social manipulation by creating personalized filter bubbles, eroding shared consensus reality and contributing to civil unrest.
Explore in the interactive Incident Tracker