Tesla Phantom Braking Complaints Surged, Allegedly Linked to Tesla Vision Rollout

In late 2021, Tesla owners’ complaints to the National Highway Traffic Safety Administration about sudden unexpected automatic braking rapidly increased, coinciding with when radar was no longer equipped in its Model 3 and Model Y vehicles.

Risk classification

• Primary risk domain: 7 AI system safety, failures, & limitations
• Primary risk subdomain: 7.3 Lack of capability or robustness

The incident is a clear case of a lack of robustness and capability in the AI's perception system (Tesla Vision), which falsely detects non-existent hazards and triggers emergency braking.

Additional risk subdomains

• 5.1 Overreliance and unsafe use: Tesla's branding of 'Autopilot' and 'Full Self-Driving' can create a false sense of security, leading to overreliance on a system that still requires constant human vigilance.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The phantom braking is caused by the deployed Tesla Autopilot/FSD AI system unexpectedly applying brakes due to false positives, which is an unintentional failure post-deployment.

EU AI Act risk tier

• Risk tier: 2 High Risk

High Risk: The system is used in critical transport infrastructure and safety-critical vehicle operations. The reports describe 'partially automated driving systems' that control braking and steering, which directly impacts physical safety on public roadways.

AI system and alleged parties

• AI system: Autopilot, Full Self-Driving (Tesla)
• AI purpose: Autonomous Driving; Threat Detection
• Behaviour type: Autonomous
• Alleged developer: Tesla
• Alleged deployer: Tesla
• Alleged harmed parties: Tesla drivers

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Minor, indirect Negligible
• Financial: direct Minor, indirect Severe
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Minor, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Property

Reported: The report explicitly describes property damage in one alleged crash.

Directly caused: A Tesla Model Y with FSD allegedly crashed and was 'severely damaged' due to an Autopilot panic or braking issue.

Inferred additional harm: Some minor vehicle damage from rear-end collisions or sudden stops is likely among the hundreds of phantom braking events.

Financial

Reported: The report describes financial losses related to vehicle damage and stock market declines.

Directly caused: The owner of the crashed Model Y suffered the loss of a severely damaged vehicle, with an estimated average financial loss of 50,000 dollars per severe crash occurrence.

Indirectly caused: Tesla Inc. suffered billions of dollars in market capitalization loss as its stock price fell by 3% and later 9% following the public disclosure of the safety issues and NHTSA probe.

Inferred additional harm: Owners of vehicles experiencing phantom braking may have incurred repair costs or vehicle depreciation, though these are not quantified in the reports.

Psychological

Reported: The report explicitly describes psychological distress and anxiety experienced by drivers and passengers.

Directly caused: Multiple drivers and passengers experienced severe anxiety, fear, and distress during sudden deceleration events at high speeds, describing them as 'terrifying' and 'hair raising'.

Inferred additional harm: Widespread anxiety and loss of trust in the vehicle's safety features likely affected a significant portion of the owners of the 416,000 vehicles covered by the probe.

People affected

• Occurrences reported: 758
• People reportedly harmed: 2
• People reportedly exposed: 758

Potential causes

Management

• Prioritizing Rapid Deployment: Rushing software updates like FSD Beta to market ahead of robust validation.
• Misleading System Marketing: Branding Level 2 systems as Autopilot and Full Self-Driving.
• Disbanding PR Department: Eliminating public relations reduced transparency and communication on issues.

Technology

• Removal of Radar Sensors: Transition to camera-only Tesla Vision removed critical sensor cross-checks.
• Improper Decision Thresholds: System thresholds misclassify non-hazards like road trash as obstacles.
• Camera Perception Vulnerabilities: Cameras struggle with environmental factors like shadows, glare, and rain.

Data Inputs

• Single Sensor Data Stream: Relying only on cameras prevents cross-checking with radar or lidar data.
• False Positive Triggers: Non-hazardous items like plastic bags or oncoming trucks trigger braking.
• Environmental Noise: Glare, reflections, and bad weather degrade visual input data quality.

Human Factors

• Bypassing Steering Pressure Sensors: Drivers easily bypass hands-on-wheel checks, leading to inattention.
• False Sense of Security: Misleading names like Autopilot lead drivers to over-rely on the system.
• Lack of Driver Intervention: Inattentive drivers fail to override sudden phantom braking events quickly.

Process and Methods

• Beta Testing on Public Roads: Releasing unfinished FSD updates to customers to test in real-world driving.
• Inadequate Edge Case Testing: Insufficient pre-release testing on metal bridges and S-shaped curves.
• Flawed Software Rollouts: Updates like FSD 10.3 introduced severe phantom braking bugs.

Regulatory Environment

• Permissive Level 2 Regulations: Lack of strict rules on testing semi-autonomous systems on public roads.
• Reactive Regulatory Oversight: NHTSA investigations began only after hundreds of owner complaints.
• Lack of Pre-Market Certification: No mandatory safety certification required before deploying ADAS updates.

Information quality

• Classification confidence: High
• Reason for confidence: The reports provide consistent, detailed accounts of the phantom braking issue, backed by official NHTSA complaint statistics (758 complaints) and investigations. The technical transition to camera-only 'Tesla Vision' is well-documented as a primary context for the surge in issues.
• Ambiguities identified: The exact number of actual crashes or minor injuries resulting specifically from the phantom braking events is somewhat ambiguous, as NHTSA reported no official injuries but some individual complaints hint at physical strain or unverified crashes.
• Alternative interpretations: Some might argue the issue is a standard mechanical/software defect rather than an AI safety issue, but the reliance on computer vision and deep learning for hazard detection makes it inherently an AI safety failure.

The incident involves a federal safety investigation into Tesla's vision-based Autopilot and FSD Beta systems following numerous reports of phantom braking. While presenting a physical safety risk on public roadways, the incident is a consumer product safety issue managed by standard regulatory processes (NHTSA) and has negligible implications for national security.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: No clear primary
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. The issue represents an ongoing consumer product safety concern rather than an active national security crisis.
• Autonomy: Human-supervised. The Autopilot and FSD systems control vehicle speed and braking autonomously but require active human supervision and intervention capability.
• Novelty: Established threat. Driver-assistance software glitches and sensor-related braking issues are known, established safety challenges in the automotive industry.

Impact by dimension

• Physical security: Minor. Phantom braking events in over 750 Tesla vehicles on public highways pose a physical safety risk to drivers and passengers, though the issue is manageable through standard regulatory safety investigations by the NHTSA.
• Information security: Negligible. No information warfare, intelligence compromise, or classified data exposure is associated with this consumer vehicle safety issue.
• Sovereignty: Negligible. The incident involves a regulatory safety probe of consumer vehicles and does not threaten state authority or government operations.
• Economic security: Negligible. While Tesla experienced temporary stock price declines following the safety probe, the incident does not pose a threat to national economic stability or strategic technological security.
• Societal stability: Negligible. The incident caused anxiety among affected drivers but does not threaten societal stability, civil liberties, or human rights.