Tesla Allegedly on Autopilot Struck High School Student Exiting School Bus

A 17-year-old student in Hollister, North Carolina who exited the school bus and was walking across the street to his house was hit by a 2022 Tesla Model Y allegedly operating on Autopilot mode, suffering a fractured neck and a broken leg.

Risk classification

• Primary risk domain: 7 AI system safety, failures, & limitations
• Primary risk subdomain: 7.3 Lack of capability or robustness

The Tesla Autopilot system failed to perform reliably by failing to detect and stop for a clearly marked, stopped school bus, demonstrating a lack of capability and robustness in real-world driving conditions.

Additional risk subdomains

• 5.1 Overreliance and unsafe use: The driver exhibited automation complacency, using steering wheel weights to bypass safety checks and failing to maintain active oversight of the vehicle.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The incident was caused by the Tesla Autopilot system failing to detect and stop for a school bus post-deployment, resulting in an unintentional collision.

EU AI Act risk tier

• Risk tier: 2 High Risk

High Risk: The system is used in critical infrastructure and transport safety, specifically as an advanced driver-assistance system in road traffic management where failures can result in severe physical injury or death.

AI system and alleged parties

• AI system: Autopilot (Tesla)
• AI purpose: Autonomous Driving; Navigation Assistant
• Behaviour type: Autonomous
• Alleged developer: Tesla
• Alleged deployer: Tesla
• Alleged harmed parties: Tillman Mitchell, the Mitchells family

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Minor, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Physical

Reported: The report explicitly describes severe physical harm to the 17-year-old student who was struck by the vehicle.

Directly caused: The student suffered a fractured neck, a broken leg, required a ventilator, and continues to experience memory problems and difficulty walking.

People affected

• Occurrences reported: 1
• People reportedly harmed: 1
• People reportedly exposed: 2

Potential causes

Management

• Aggressive Rollout of FSD: Expanding FSD from 12k to 400k users increased exposure to crashes.
• Removal of Critical Sensors: Management stripped radar sensors from vehicles to simplify hardware.
• Prioritizing Deployment over Safety: Management pushed technology deployment despite known safety flaws.

Technology

• Autopilot Detection Failure: System failed to detect and slow down for the stopped school bus.
• Easily Bypassed Safeguards: Steering wheel pressure check was bypassed with aftermarket weights.
• Lack of Redundant Sensors: Removal of radar sensors left the system reliant solely on cameras.

Data Inputs

• Missing Radar Sensor Data: Stripping vehicles of radar deprived the AI of critical distance data.
• Camera-Only Vision Limitations: Camera inputs alone failed to resolve the school bus hazard.

Human Factors

• Automation Complacency: Driver over-trusted the system, leading to severe distraction.
• Active System Deception: Driver attached weights to the wheel to trick the hands-on sensor.
• Misleading System Naming: The term 'Autopilot' encouraged drivers to believe the car was autonomous.

Process and Methods

• Public Beta Testing of FSD: Testing experimental software on public roads with untrained drivers.
• Inadequate Safety Verification: Deploying updates to fix critical flaws only after incidents occurred.

Regulatory Environment

• Lack of Strict AV Regulations: Absence of federal standards preventing deployment of unverified AV tech.
• Redaction of Safety Critical Data: Tesla redacted software details from public NHTSA crash databases.

Information quality

• Classification confidence: High
• Reason for confidence: The reports provide clear, detailed, and consistent accounts of the specific crash, the injuries sustained, the driver's actions (using weights to bypass safety checks), and the broader context of NHTSA investigations into Tesla Autopilot.
• Ambiguities identified: Whether Autopilot was definitively active at the exact second of impact is described as 'allegedly' or under investigation, though police and witness reports strongly point to its use.
• Alternative interpretations: The crash could be interpreted purely as a case of driver negligence and distracted driving rather than an AI safety failure, given the driver's intentional bypass of safety features.

A localized traffic accident in North Carolina where a student was injured by a Tesla on Autopilot. The driver bypassed safety features using steering wheel weights. The incident represents a minor physical safety concern regarding consumer autonomous systems, but carries negligible implications for broader national security.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Individual

Threat characteristics

• Imminence: Long-term. The issue of driver-assistance safety is an ongoing regulatory and technical challenge rather than an immediate national security crisis.
• Autonomy: Human-supervised. The Autopilot system is designed to operate with active human supervision, though the driver deliberately bypassed these safety monitoring controls.
• Novelty: Established threat. This incident is part of an established pattern of similar crashes involving Tesla Autopilot, which has been subject to ongoing federal investigations.

Impact by dimension

• Physical security: Minor. The incident involved physical injury to a civilian due to an AI system failure on public roads. While serious, it remains a localized traffic safety issue under regulatory review rather than a systemic threat to critical infrastructure.
• Information security: Negligible. There is no indication of intelligence compromise, classified data theft, or information warfare associated with this consumer vehicle accident.
• Sovereignty: Negligible. This incident does not threaten state authority, territorial control, or core government operations.
• Economic security: Negligible. While involving a major US technology company, a single consumer autopilot crash does not threaten strategic economic stability or technological competitive advantage.
• Societal stability: Negligible. The incident is a localized traffic accident and does not pose a threat to social cohesion, civil liberties, or population-scale stability.