Workday's AI Tools Allegedly Enabled Employers to Discriminate against Applicants of Protected Groups

Workday's algorithmic screening systems were alleged in a lawsuit allowing employers to discriminate against African-Americans, people over 40, and people with disabilities.

Risk classification

• Primary risk domain: 1 Discrimination & Toxicity
• Primary risk subdomain: 1.3 Unequal performance across groups

The lawsuit alleges that the screening system performs with unequal effectiveness across demographic groups, resulting in systematic bias and rejections for Black, older, and disabled job applicants.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The alleged discrimination was caused by the automated decisions of Workday's deployed applicant screening system, which represents an unintentional biased outcome of its recruitment goals.

EU AI Act risk tier

• Risk tier: 2 High Risk

High Risk: The system is an employment and worker management system used in recruitment, which is explicitly classified as High Risk under the EU AI Act.

AI system and alleged parties

• AI system: Workday's algorithmic screening systems
• AI purpose: Application Evaluation; Workforce Administration
• Behaviour type: Assistant
• Alleged developer: Workday
• Alleged deployer: Workday
• Alleged harmed parties: Derek Mobley, applicants with disabilities, applicants over 40, African American applicants

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Minor, indirect Negligible
• Civil rights: direct Minor, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Differential treatment

Reported: Yes, the report explicitly describes allegations of differential treatment based on race, age, and disability.

Directly caused: The Workday screening system allegedly recommended rejecting the plaintiff and other applicants based on their race (Black), age (over 40), and/or disability status.

Inferred additional harm: Systemic differential treatment likely affected thousands of other job applicants from protected groups who used the Workday platform.

Civil rights

Reported: Yes, the report describes allegations of unlawful discrimination in employment screening.

Directly caused: The screening tool allegedly violated civil rights by enabling discriminatory hiring practices against Black, older, and disabled applicants.

Inferred additional harm: Widespread civil rights violations regarding equal employment opportunity likely occurred across multiple companies using Workday's screening tools.

People affected

• Occurrences reported: 1
• People reportedly harmed: 1
• People reportedly exposed: 1

Potential causes

Management

• Inadequate Risk Mitigation: Management failed to prevent discriminatory tool configurations by clients.

Technology

• Flawed Screening Algorithms: Algorithms allegedly filter candidates based on race, age, or disability.
• Configurable Bias Tools: Tools allow customers to manipulate screening in a discriminatory manner.

Data Inputs

• Subjective Input Data: Screening relies on subjective inputs that carry historical bias.
• Biased Training Data: Human-created inputs reflect conscious or unconscious biases.

Human Factors

• Unconscious Bias of Creators: System creators build their own biases into the screening algorithms.
• Discriminatory Customer Intent: Customers configure tools to intentionally screen out certain demographics.

Process and Methods

• Subjective Screening Practices: Recruitment processes allow subjective, non-standardized evaluation.
• Inadequate Algorithmic Review: Review processes failed to catch and mitigate discriminatory outcomes.

Regulatory Environment

• Lack of Algorithmic Audits: Absence of strict legal requirements for auditing AI hiring tools.

Information quality

• Classification confidence: High
• Reason for confidence: The report clearly outlines the legal allegations, the specific AI system (Workday's screening tool), the affected demographic groups, and the nature of the alleged bias. While it is a lawsuit and the allegations are denied by Workday, the details of the safety risk (algorithmic discrimination in hiring) are unambiguous.
• Ambiguities identified: The report does not detail the specific technical mechanisms of Workday's algorithms or how employers configure them, nor does it prove the allegations as the lawsuit is ongoing.
• Alternative interpretations: The bias could be attributed to the specific configurations set by Workday's customers rather than Workday's default algorithms, as noted in the claim that tools allow customers to 'manipulate and configure them in a discriminatory manner'.

A class-action lawsuit alleges that Workday's AI-based applicant screening tool systematically discriminates against Black, older, and disabled job seekers. While highlighting significant concerns regarding algorithmic bias and civil rights, the incident is a domestic civil matter with minor national security implications, manageable through standard legal and regulatory frameworks.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. Represents an ongoing civil rights and regulatory concern rather than an active, imminent national security crisis.
• Autonomy: Human-supervised. The screening system autonomously evaluates and recommends candidate rejections, but operates within human-configured parameters and employer oversight.
• Novelty: Established threat. Algorithmic bias in employment and recruitment tools is a well-known issue with extensive academic and regulatory precedents.

Impact by dimension

• Physical security: Negligible. The incident involves commercial HR screening software and poses no threat to physical infrastructure, kinetic systems, or human safety.
• Information security: Negligible. No compromise of intelligence capabilities, classified models, or information operations are associated with this commercial software lawsuit.
• Sovereignty: Negligible. This is a domestic civil lawsuit against a private corporation and does not impact state authority, border control, or core government decision-making.
• Economic security: Negligible. While affecting employment opportunities, the incident does not threaten strategic industries, critical supply chains, or national technological advantages.
• Societal stability: Minor. Alleges systematic algorithmic discrimination against protected demographic groups in hiring, but the impact is domestic and manageable through standard civil legal processes.