Tesla Allegedly Misled Customers about Autopilot and FSD Capabilities

California’s Department of Motor Vehicles (DMV) accused Tesla of false advertising in its promotion of Autopilot and Full Self-Driving (FSD) technologies, alleging the company to have made untrue or misleading claims with marketing language about the capabilities of its products.

Risk classification

• Primary risk domain: 5 Human-Computer Interaction
• Primary risk subdomain: 5.1 Overreliance and unsafe use

Tesla's misleading marketing induced drivers to overrely on the Autopilot and FSD systems, treating them as fully autonomous and leading to complacency and fatal crashes.

Additional risk subdomains

• 7.3 Lack of capability or robustness: The Autopilot system exhibited a lack of robustness by failing to detect stationary emergency vehicles and motorcyclists, leading to multiple crashes.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The primary risk arises from human decisions by Tesla executives to intentionally publish misleading advertisements and staged promotional videos post-deployment.

EU AI Act risk tier

• Risk tier: 2 High Risk

High Risk: The AI system is used in road traffic management and safety-critical transport infrastructure, and has been linked to multiple fatal accidents and regulatory safety investigations.

AI system and alleged parties

• AI system: Full Self-Driving (Tesla)
• AI purpose: Autonomous Driving; Navigation Assistant
• Behaviour type: Assistant
• Alleged developer: Tesla
• Alleged deployer: Tesla
• Alleged harmed parties: Tesla customers, California residents, California Department of Motor Vehicles

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Substantial. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Substantial, indirect Substantial
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Minor
• Financial: direct Negligible, indirect Minor
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Minor, indirect Substantial
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Physical

Reported: The reports explicitly describe multiple physical crashes, including some fatal accidents, involving Tesla's Autopilot system.

Directly caused: The reports note a fatal accident where a Tesla using Autopilot hit and killed a motorcyclist, as well as over a dozen other crashes under investigation.

Indirectly caused: Misleading marketing led to driver complacency, indirectly causing over a dozen crashes, some of which were fatal.

Inferred additional harm: Given the 273 reported crashes involving Tesla's driver-assist systems, it is highly likely that dozens of additional unquantified injuries and fatalities occurred.

Property

Reported: The reports explicitly describe property damage, including a Tesla crashing into a fence and multiple collisions with parked emergency vehicles.

Directly caused: A Tesla test vehicle crashed into a fence during the staging of the 2016 promotional video.

Indirectly caused: Significant damage to Teslas and emergency vehicles occurred during the dozens of Autopilot-related crashes.

Inferred additional harm: The 273 reported crashes likely resulted in millions of dollars of property damage to the vehicles involved.

Financial

Reported: The reports describe customers paying $12,000 extra for the Full Self-Driving feature based on misleading claims.

Indirectly caused: Tesla customers suffered financial losses of $12,000 per FSD purchase due to deceptive marketing of the system's capabilities.

Inferred additional harm: Total financial losses to consumers who purchased FSD under false pretenses likely run into millions of dollars, alongside potential legal and regulatory fines for Tesla.

Epistemic

Reported: The reports explicitly describe epistemic harm through false advertising and a staged promotional video.

Directly caused: Tesla published a staged video in 2016 and made untrue claims on its website, misleading consumers, investors, and regulators about its autonomous capabilities.

Indirectly caused: The dissemination of false claims eroded public and regulatory trust in autonomous vehicle technology and safety standards.

Inferred additional harm: Widespread confusion regarding the true capabilities of driver-assist systems, leading to a polluted information ecosystem regarding AI safety.

People affected

• Occurrences reported: 1
• People reportedly harmed: 273
• People reportedly exposed: 830000

Potential causes

Management

• Prioritizing Value Over Safety: Musk stated Tesla is worth basically zero without Full Self-Driving.
• Intentional Misleading Claims: Executives directed the staging of promotional videos to exaggerate features.
• Disbanding PR Department: Tesla disbanded its media relations department, reducing public accountability.

Technology

• Sensor Detection Failures: Sensors missed emergency vehicles and confused the moon for traffic lights.
• Inability to Detect Signals: The 2016 production Autopilot could not respond to traffic lights.

Data Inputs

• Withholding Crash Data: Tesla did not share onboard computer crash data with the public.
• Confused Environmental Inputs: Autopilot sensors confused the moon for a yellow traffic light.

Human Factors

• Driver Complacency: Misleading branding induced drivers to become complacent behind the wheel.
• False Sense of Security: Overstated capabilities led users to treat vehicles as fully autonomous.
• Active Supervision Failures: Drivers failed to maintain control or keep hands on the wheel during use.

Process and Methods

• Staged Promotional Materials: Tesla staged a 2016 self-driving video to portray nonexistent capabilities.
• Contradictory Disclaimers: Fine-print warnings contradicted bold claims of full autonomy.
• Inadequate Driver Education: Tesla failed to properly educate drivers on the limits of its ADAS systems.

Regulatory Environment

• Lack of Proactive Oversight: Regulators investigated crashes retrospectively rather than preventing them.
• Insufficient Advertising Rules: Regulators struggled to prevent misleading branding like 'Full Self-Driving'.
• Delayed Regulatory Actions: Investigations by DMV and NHTSA occurred years after systems were deployed.

Information quality

• Classification confidence: High
• Reason for confidence: The reports provide consistent, detailed accounts of the regulatory and criminal investigations from multiple reputable news outlets. The staging of the 2016 video is confirmed by official deposition testimony from Tesla's Autopilot software director, providing high certainty.
• Ambiguities identified: The exact number of injuries and fatalities across all 273 crashes is not fully detailed in the text.
• Alternative interpretations: Tesla argues that the crashes are due to driver misuse contrary to written instructions, rather than system failure or deceptive marketing.

Tesla faces federal and state investigations over deceptive marketing of its Autopilot and FSD systems, highlighted by a staged 2016 promotional video. While the technology has been linked to numerous crashes and fatalities, the incident is a consumer safety and corporate governance issue with negligible direct national security implications.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Tesla Management

Threat characteristics

• Imminence: Long-term. Represents an ongoing regulatory and safety compliance concern rather than an immediate national security crisis.
• Autonomy: Human-supervised. The systems operate with physical autonomy but require active human supervision and intervention to prevent accidents.
• Novelty: Established threat. Driver-assist system failures and deceptive corporate marketing are well-established issues with existing regulatory frameworks.

Impact by dimension

• Physical security: Minor. Multiple consumer vehicle crashes, including fatalities, occurred due to overreliance on driver-assist systems. However, these are localized traffic safety incidents manageable under standard regulatory and law enforcement procedures, rather than a systemic threat to critical infrastructure.
• Information security: Negligible. The deceptive marketing and staged video represent corporate misrepresentation rather than state-sponsored disinformation or compromise of intelligence capabilities.
• Sovereignty: Negligible. No disruption to core government operations, electoral systems, or state authority. The matter is being handled through standard judicial and regulatory channels.
• Economic security: Negligible. While consumers suffered financial losses from deceptive marketing, the incident does not threaten national financial systems, critical supply chains, or strategic technological competitive advantage.
• Societal stability: Negligible. No implications for mass surveillance, systemic discrimination, civil liberties, or large-scale societal instability.