Facebook Allegedly Failed to Police Hate Speech Content That Contributed to Ethnic Violence in Ethiopia

Facebook's recommendation algorithms and content moderation failures in Ethiopia have been linked to the amplification of hate speech, disinformation, and incitement to violence against ethnic groups. Internal documents and legal filings allege that the platform's engagement-based ranking systems prioritized inflammatory content, while the company failed to provide adequate moderation resources for local languages like Amharic, Oromo, and Tigrinya. This environment contributed to real-world atrocities, including the targeted murder of individuals and widespread ethnic violence.

Facebook allegedly did not adequately remove hate speech, some of which was extremely violent and dehumanizing, on its platform including through automated means, contributing to the violence faced by ethnic communities in Ethiopia.

Source: AI Incident Database

Risk classification

  • Primary risk domain: 1 Discrimination & Toxicity
  • Primary risk subdomain: 1.2 Exposure to toxic content

The primary risk and reported harm stem from Facebook's algorithms exposing users to and actively amplifying extreme hate speech, genocidal rhetoric, and direct incitement to violence against ethnic minorities.

Additional risk subdomains

  • 1.3 Unequal performance across groups: Meta underinvested in safety resources for African languages, resulting in severely unequal moderation performance and protection for Ethiopian users compared to US users.
  • 7.3 Lack of capability or robustness: The automated moderation systems lacked basic capabilities, such as language classifiers for Amharic and Oromo, failing to perform reliably in a high-risk conflict zone.

Causal factors

  • Entity: AI
  • Intent: Unintentional
  • Timing: Post-deployment

The real-world harms were driven by the post-deployment operations of Facebook's engagement-ranking and recommendation algorithms, which unintentionally amplified toxic content as a systemic byproduct of maximizing user engagement.

EU AI Act risk tier

  • Risk tier: 1 Unacceptable

Unacceptable Risk: The reports describe an AI system (engagement-based ranking and recommendation algorithms) used for behavioral influence and manipulation that prioritized and amplified hate speech and incitement to violence, leading to severe physical harm and systemic violations of fundamental rights.

AI system and alleged parties

  • AI system: Facebook algorithm (Meta)
  • AI purpose: Content Recommendation; Content Moderation
  • Behaviour type: Autonomous
  • Alleged developer: Meta, Facebook
  • Alleged deployer: Meta, Facebook
  • Alleged harmed parties: Tigrinya-speaking Facebook users, Facebook users in Ethiopia, Ethiopian public, Afaan Oromo-speaking Facebook users

Harm severity

Highest direct severity in any category: Catastrophic. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

  • Physical: direct Negligible, indirect Severe
  • Infrastructure: direct Negligible, indirect Minor
  • Property: direct Negligible, indirect Substantial
  • Financial: direct Negligible, indirect Severe
  • Environmental: direct Negligible, indirect Negligible
  • Malicious content: direct Substantial, indirect Severe
  • Differential treatment: direct Substantial, indirect Substantial
  • Civil rights: direct Negligible, indirect Substantial
  • Democracy: direct Negligible, indirect Minor
  • Privacy: direct Negligible, indirect Minor
  • Psychological: direct Minor, indirect Substantial
  • Epistemic: direct Substantial, indirect Severe
  • Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Physical

Reported: The reports explicitly describe numerous fatalities and physical violence resulting from unmoderated incitement on the platform.

Directly caused: N/A

Indirectly caused: Professor Meareg Amare Abrha was shot dead outside his home after being targeted by viral Facebook posts. Over 160 people were killed in mob violence following the death of Hachalu Hundessa, which was actively fueled by Facebook posts. A Qemant village was pillaged and burned down following a false post on Facebook.

Inferred additional harm: It is highly likely that thousands of additional deaths and injuries in the Ethiopian civil war were indirectly fueled or accelerated by the unchecked spread of genocidal rhetoric and ethnic incitement on Facebook.

Infrastructure

Reported: The reports explicitly describe the destruction of community infrastructure.

Directly caused: N/A

Indirectly caused: An entire Qemant village was pillaged and burnt down, destroying local homes and community infrastructure, following a false Facebook post alleging terrorism.

Inferred additional harm: Widespread destruction of public and private infrastructure occurred during the ethnic clashes and military offensives that were coordinated and incited via the platform.

Property

Reported: The reports explicitly describe property damage linked to online incitement.

Directly caused: N/A

Indirectly caused: The burning and pillaging of a Qemant village resulted in the total loss of homes and personal property for thousands of fleeing civilians.

Inferred additional harm: Extensive property damage, including looted businesses and destroyed homes, occurred during the broader civil unrest fueled by unmoderated platform content.

Financial

Reported: The reports describe a massive legal claim seeking financial restitution for victims.

Directly caused: N/A

Indirectly caused: The lawsuit filed in Kenya's High Court seeks the establishment of a 200 billion Ksh (approximately $1.6 billion USD) restitution fund for victims of hate and violence incited on Facebook.

Inferred additional harm: Displaced families and destroyed businesses suffered catastrophic, unquantified financial ruin due to the violence fueled by the platform's algorithmic amplification.

Malicious content

Reported: The reports explicitly describe a massive proliferation of toxic and malicious content.

Directly caused: Facebook's recommendation algorithms actively promoted and amplified hateful, violent, and genocidal posts because they generated high user engagement.

Indirectly caused: Users, diaspora groups, and state-affiliated actors created and shared massive volumes of hate speech, ethnic slurs, and calls for genocide (e.g., calling Tigrayans 'weeds' and 'cancer').

Inferred additional harm: Millions of users across East Africa were exposed to highly toxic, dehumanizing, and violent content due to the platform's systemic moderation failures.

Differential treatment

Reported: The reports explicitly describe systemic differential treatment in safety protections.

Directly caused: Meta's safety and moderation systems performed significantly worse for Ethiopian languages due to a lack of classifiers and human reviewers, representing unequal protection compared to Western users.

Indirectly caused: Ethnic minorities faced targeted harassment, doxing, and physical violence due to the platform's failure to enforce safety standards equitably.

Inferred additional harm: Systemic underinvestment in safety resources likely resulted in similar differential treatment and heightened risk for other non-Western, at-risk nations.

Civil rights

Reported: The reports explicitly describe severe violations of fundamental human and civil rights.

Directly caused: N/A

Indirectly caused: The platform's failure to curb incitement directly contributed to violations of the right to life, physical security, and freedom from discrimination, as highlighted in the Kenyan High Court lawsuit.

Inferred additional harm: The systemic amplification of genocidal rhetoric facilitated widespread crimes against humanity and ethnic cleansing, representing a catastrophic failure of human rights protections.

Democracy

Reported: The reports explicitly describe the erosion of democratic norms and political stability.

Directly caused: N/A

Indirectly caused: State-affiliated actors (such as INSA) used coordinated networks of fake accounts to spread disinformation, polarize the public, and undermine democratic transitions and peace processes.

Inferred additional harm: The polarization of the information ecosystem has caused long-term damage to social cohesion, trust in public institutions, and democratic governance in Ethiopia.

Privacy

Reported: The reports explicitly describe targeted privacy violations.

Directly caused: N/A

Indirectly caused: Facebook posts doxed Professor Meareg Amare, revealing identifying personal details and his location shortly before he was murdered.

Inferred additional harm: Numerous other activists, journalists, and academics likely had their private information exposed, placing their lives and families at risk.

Psychological

Reported: The reports explicitly describe severe psychological trauma and distress experienced by victims' families.

Directly caused: Moti Dereje was severely traumatized and depressed after discovering his father's dead body via a viral Facebook post, which remained online for over four years despite repeated reports.

Indirectly caused: Widespread fear, anxiety, and acute distress among ethnic Tigrayans, Amharas, and Oromos who were subjected to dehumanizing campaigns and violent threats online.

Inferred additional harm: Millions of Ethiopian users exposed to graphic images of violence, such as the video of a Tigrayan man burned alive, likely suffered severe, unquantified psychological trauma.

Epistemic

Reported: The reports explicitly describe severe epistemic harm and the spread of misinformation.

Directly caused: Recommendation algorithms created powerful echo chambers, filter bubbles, and information cascades that hardened ethnic divisions.

Indirectly caused: The platform was flooded with unverified rumors, conspiracy theories, and fabricated claims (e.g., false allegations of a bus hijacking or political plots) that eroded shared reality.

Inferred additional harm: The widespread pollution of the information ecosystem has made it extremely difficult for citizens to access credible news, severely hindering peace and reconciliation efforts.

People affected

  • Occurrences reported: 1
  • People reportedly harmed: 165
  • People reportedly exposed: 6000000

Potential causes

Management

  • Prioritizing Profit Over Safety: Meta prioritized user engagement and profits over safety in at-risk markets.
  • Underinvestment in At-Risk Markets: Management underfunded safety systems and moderation in African regions.
  • Ignoring Employee Warnings: Management ignored internal warnings about algorithmically fueled violence.

Technology

  • Engagement-Based Algorithms: Algorithms prioritized hateful content to maximize user engagement.
  • Lack of Language Classifiers: AI lacked classifiers for Amharic and Oromo to auto-detect hate speech.
  • Opaque Network-Based Models: Experimental network-based moderation models were opaque and ineffective.

Data Inputs

  • Inadequate Local Language Signals: Lack of local language data limited the training of effective AI classifiers.
  • Low User Reporting Completion: Confusing interfaces led to low rates of completed user reports.
  • Gaps in Platform Signals: Gaps in user and partner data signals hindered threat detection.

Human Factors

  • Low Digital Literacy: Users struggled with confusing reporting interfaces due to digital literacy.
  • Mental Toll on Volunteers: Grassroots volunteers faced severe trauma from reviewing graphic content.
  • Diaspora-Led Hate Campaigns: Diaspora groups actively weaponized the platform to stoke ethnic division.

Process and Methods

  • Slow Content Removal Response: Moderation processes took days or years to remove flagged violent posts.
  • Inadequate Moderation Staffing: Only 25 moderators handled content for a country of over 110 million.
  • Confusing Reporting Interfaces: Reporting tools lacked local language support, hindering user reports.

Regulatory Environment

  • Weak Regulatory Oversight: Lack of regulatory mandates allowed unsafe algorithms to operate unchecked.
  • State Censorship and Shutdowns: Internet shutdowns and media censorship obscured severe human rights abuses.
  • Lack of Civil Rights Protections: Legal frameworks failed to protect citizens from algorithmically fueled harm.

Information quality

  • Classification confidence: High
  • Reason for confidence: The assessment is supported by extensive, consistent, and detailed evidence from multiple highly credible sources, including internal leaked Meta documents (the Facebook Papers), whistleblower testimony, human rights organizations, and formal legal filings in Kenya's High Court.
  • Ambiguities identified: The precise quantitative proportion of real-world violence directly caused by algorithmic amplification versus pre-existing geopolitical tensions is difficult to isolate.
  • Alternative interpretations: The events could be viewed primarily as a geopolitical conflict where social media was merely a passive tool used by human actors, rather than an AI-driven safety failure.

Meta's autonomous recommendation algorithms systematically amplified ethnic hate speech, disinformation, and incitement to violence in Ethiopia. This algorithmic failure severely exacerbated ethnic tensions, directly contributing to mob violence, targeted killings, and widespread civil unrest during a period of civil war, highlighting the profound threat of unmoderated AI systems to societal stability.

  • Overall national security impact: Severe
  • Response level: Severe
  • Scope: Single nation
  • Primary target: Ethiopia
  • Alleged perpetrator: State-affiliated actors and local ethnic groups

Threat characteristics

  • Imminence: Long-term. Represents an ongoing, systemic algorithmic amplification issue spanning multiple years rather than a sudden 72-hour crisis.
  • Autonomy: Full autonomy. The engagement-based recommendation algorithms operated autonomously to prioritize and amplify content without real-time human intervention.
  • Novelty: Evolved capability. Represents a significant escalation of algorithmic amplification of violence in a complex, multi-lingual conflict zone with severe real-world consequences.

Impact by dimension

  • Physical security: Minor. Indirect physical harm through mob violence and village destruction, but no direct AI control of physical systems or critical infrastructure.
  • Information security: Substantial. State-affiliated and local actors exploited AI recommendation algorithms to spread coordinated disinformation and ethnic hate speech during an active civil war.
  • Sovereignty: Substantial. Algorithmic amplification of polarizing content and coordinated disinformation campaigns undermined democratic transitions, peace processes, and state stability.
  • Economic security: Negligible. No significant threats to Ethiopia's strategic industries, financial systems, or technological competitive advantage are indicated.
  • Societal stability: Severe. Algorithmic amplification of genocidal rhetoric and ethnic hate speech directly fueled widespread civil unrest, mob violence, and human rights violations during a civil war.
Explore in the interactive Incident Tracker