Houston Schools Must Face Teacher Evaluation Lawsuit

On May 4, 2017, a U.S. federal judge advanced teachers’ claims that the Houston Independent School District’s algorithmic teacher evaluations violated their due process rights to their jobs by not allowing them to review the grounds of their termination.

Risk classification

• Primary risk domain: 7 AI system safety, failures, & limitations
• Primary risk subdomain: 7.4 Lack of transparency or interpretability

The core of the dispute is the proprietary, 'trade secret' nature of the EVAAS algorithm, which prevented teachers and the school district from understanding or verifying how performance scores were calculated.

Additional risk subdomains

• 5.2 Loss of human agency and autonomy: The school district delegated high-stakes employment evaluation and termination decisions to an automated system without providing a meaningful way for humans to review or appeal the algorithmic outputs.
• 6.2 Increased inequality and decline in employment quality: The automated evaluation system created job insecurity and systemic pressure on teachers, negatively impacting their employment quality and working conditions.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The due process violations and potential wrongful terminations arose from the post-deployment operation of the EVAAS scoring algorithm, which was deployed to evaluate teachers.

EU AI Act risk tier

• Risk tier: 2 High Risk

Risk Level 2: High Risk. The system is an employment and worker management system used to evaluate teacher performance and make termination decisions, which directly affects employment.

AI system and alleged parties

• AI system: None named
• AI purpose: Workforce Monitoring and Evaluation; Automatic Skill Assessment
• Behaviour type: Assistant
• Alleged developer: SAS Institute
• Alleged deployer: Houston Independent School District
• Alleged harmed parties: Houston Independent School District teachers

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Substantial. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Substantial, indirect Negligible
• Civil rights: direct Minor, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Differential treatment

Reported: Yes, the report describes teachers being evaluated and targeted for termination based on proprietary algorithmic scores.

Directly caused: Teachers rated as 'ineffective' by the proprietary EVAAS algorithm were singled out for termination, with the district aiming to fire 85% of those so classified.

Civil rights

Reported: Yes, the report explicitly describes a lawsuit alleging violations of teachers' Fourteenth Amendment procedural due process rights.

Directly caused: The proprietary nature of the EVAAS algorithm prevented teachers from verifying their scores, violating their procedural due process rights to challenge termination decisions.

People affected

• Occurrences reported: 1
• People reportedly harmed: 9
• People reportedly exposed: 6100

Potential causes

Management

• Aggressive Termination Goal: HISD set a goal to fire 85 percent of teachers rated ineffective.
• Lack of Transparency: Management adopted a system without ensuring explainability for employees.

Technology

• Proprietary Algorithm: SAS kept the EVAAS algorithm a trade secret, preventing verification.
• Potential Software Glitches: Code errors or data entry mistakes could erroneously calculate scores.

Data Inputs

• Standardized Test Scores: System relied heavily on student standardized test scores for evaluation.
• Data-Entry Mistakes: Incorrect input data could lead to erroneous teacher evaluation scores.

Human Factors

• Blind Trust in Algorithm: District relied on the system without providing a way to verify accuracy.

Process and Methods

• Lack of Verification Process: No process existed for teachers to independently test or verify their scores.
• Inadequate Dispute Mechanism: Teachers could not challenge the evidence used for termination decisions.

Regulatory Environment

• Due Process Violations: Evaluation system failed to provide teachers with detailed basis for firing.

Information quality

• Classification confidence: High
• Reason for confidence: The reports clearly outline the legal dispute, the parties involved, the AI system (EVAAS), and the specific civil rights issues (due process). The facts regarding the lawsuit and the court's ruling are well-documented.
• Ambiguities identified: The exact number of teachers actually fired under the system is not specified in the report, as the district spokeswoman stated a public-information request would be required.
• Alternative interpretations: None. The incident is clearly a legal dispute over algorithmic transparency in employment evaluation.

A domestic legal dispute in the United States concerning a school district's use of a proprietary teacher evaluation algorithm. The federal court ruled that using secret algorithms for high-stakes employment decisions without a way to challenge the scores violates procedural due process. The national security impact is negligible to minor, primarily touching on domestic civil rights and administrative law.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. This represents an ongoing legal and policy concern regarding algorithmic transparency in public sector employment rather than an active security crisis.
• Autonomy: Human-controlled. The AI system assisted in evaluating performance, but human administrators made the final decisions regarding employment and termination.
• Novelty: Evolved capability. The case represents a significant early legal challenge and precedent regarding procedural due process and the use of proprietary algorithms in public employment.

Impact by dimension

• Physical security: Negligible. The incident involves an educational evaluation algorithm and has no impact on physical systems, critical infrastructure, or human safety.
• Information security: Negligible. There is no indication of information warfare, intelligence compromise, or hostile foreign disinformation campaigns.
• Sovereignty: Negligible. While involving a public school district, the incident is a local administrative and labor dispute rather than a threat to national sovereignty or core federal government operations.
• Economic security: Negligible. The incident does not threaten national financial systems, strategic industries, or the nation's overall technological competitive advantage.
• Societal stability: Minor. The incident touches on civil rights, specifically Fourteenth Amendment procedural due process rights for public employees subjected to opaque algorithmic evaluations, but is manageable within standard legal procedures.