A video shared on Twitter by the 'Whole Mars Catalog' account shows a Tesla vehicle running FSD Beta 11.4.1 failing to yield to a pedestrian in a marked crosswalk in San Francisco. Although the vehicle's sensors detected the pedestrian, the system proceeded through the intersection instead of stopping, which is a violation of California traffic law. The incident has sparked controversy regarding the safety of deploying unfinished autonomous driving software on public roads and the ethical implications of programming AI to mimic potentially illegal human driving behaviors.
A Tesla on FSD Beta 11.4.1 was shown on video not yielding to a pedestrian detected by the car, reportedly violating the state law sign which was also in the video saying vehicles having to yield to pedestrian within crosswalk.
Risk classification
- Primary risk domain: 7 AI system safety, failures, & limitations
- Primary risk subdomain: 7.3 Lack of capability or robustness
The Tesla FSD system failed to perform reliably and safely by failing to yield to a pedestrian in a marked crosswalk, representing a clear capability and robustness failure in real-world conditions.
Additional risk subdomains
- 5.1 Overreliance and unsafe use: Tesla fans and drivers demonstrated overreliance by defending the vehicle's illegal and unsafe behavior as 'human-like' and exciting.
- 6.5 Governance failure: The incident highlights regulatory gaps allowing unfinished, potentially unsafe autonomous driving software to be tested on public roads around vulnerable pedestrians.
Causal factors
- Entity: AI
- Intent: Unintentional
- Timing: Post-deployment
The risk was caused by the Tesla FSD AI system's decision to proceed through the crosswalk instead of yielding, which was an unexpected and unsafe outcome during post-deployment operation.
EU AI Act risk tier
High Risk: The system is an AI application used in critical transport infrastructure and safety-critical systems. The reports describe FSD Beta acting unsafely around intersections and failing to yield to pedestrians, posing significant safety risks.
AI system and alleged parties
- AI system: Full Self-Driving Beta 11.4.1 (Tesla)
- AI purpose: Autonomous Driving; Navigation Assistant
- Behaviour type: Autonomous
- Alleged developer: Tesla
- Alleged deployer: Tesla
- Alleged harmed parties: pedestrians
Harm severity
Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
- Physical: direct Negligible, indirect Negligible
- Infrastructure: direct Negligible, indirect Negligible
- Property: direct Negligible, indirect Negligible
- Financial: direct Negligible, indirect Negligible
- Environmental: direct Negligible, indirect Negligible
- Malicious content: direct Negligible, indirect Negligible
- Differential treatment: direct Negligible, indirect Negligible
- Civil rights: direct Negligible, indirect Negligible
- Democracy: direct Negligible, indirect Negligible
- Privacy: direct Negligible, indirect Negligible
- Psychological: direct Negligible, indirect Negligible
- Epistemic: direct Negligible, indirect Negligible
- Child sexual exploitation and abuse: direct Negligible, indirect Negligible
People affected
- Occurrences reported: 1
- People reportedly exposed: 1
Potential causes
Management
- Prioritizing Growth Over Safety: Musk views FSD as make-or-break, pushing rapid updates to recognize revenue.
- Discrepancy in Capability Claims: Tesla claims full autonomy publicly but tells DMV it is only Level 2.
Technology
- Flawed Pedestrian Algorithms: Algorithms allowed the car to bypass stopping despite detecting the pedestrian.
- Imitation of Bad Human Driving: Software programmed to mimic human shortcuts rather than strictly obeying laws.
Human Factors
- Driver Over-reliance on Beta: Drivers trust unfinished beta software to make safety-critical decisions.
- Normalization of Lawbreaking: Fans and drivers defend illegal driving behavior as bullish and human-like.
Process and Methods
- Testing Beta on Public Roads: Tesla tests unfinished software on surface streets without geofencing.
- Lack of Public Safety Debate: New driving norms are rolled out without democratic or regulatory oversight.
Regulatory Environment
- Permissive Level 2 Regulations: Regulators allow testing on public roads by shifting liability to the driver.
- Inadequate Software Restrictions: Lack of geofencing mandates allows FSD to operate in complex pedestrian zones.
Information quality
- Classification confidence: High
- Reason for confidence: The incident is documented by a specific video clip analyzed consistently across multiple reputable news sources. The software version, location, and nature of the failure are clearly identified with no major factual contradictions.
- Ambiguities identified: The exact internal logic of the FSD software's decision-making process is not fully detailed, leaving some ambiguity over whether it miscalculated the pedestrian's speed or intentionally bypassed the yield rule.
- Alternative interpretations: Tesla supporters interpret the vehicle's action as a safe, human-like bypass because there was sufficient space, whereas critics and legal standards interpret it as a clear traffic violation and safety failure.
A consumer Tesla vehicle operating on Full Self-Driving Beta failed to yield to a pedestrian in San Francisco. While highlighting ongoing safety and regulatory challenges for autonomous vehicle deployment, this localized traffic incident carries negligible national security implications.
- Overall national security impact: Negligible
- Response level: Minor
- Scope: Single nation
- Primary target: No clear primary
- Alleged perpetrator: Unknown
Threat characteristics
- Imminence: Long-term. The incident represents an ongoing consumer safety and regulatory concern rather than an active national security crisis requiring urgent response.
- Autonomy: Human-supervised. The vehicle operated on Tesla's Full Self-Driving Beta, which is a Level 2 autonomous system requiring active driver supervision and intervention capabilities.
- Novelty: Established threat. Autonomous vehicle software errors and failure to yield to pedestrians are well-documented, established issues that have occurred in previous testing.
Impact by dimension
- Physical security: Negligible. A localized traffic violation involving a single consumer vehicle failing to yield to a pedestrian poses no threat to critical infrastructure or national physical security.
- Information security: Negligible. No evidence of information warfare, intelligence compromise, or systemic disinformation campaigns associated with this consumer vehicle incident.
- Sovereignty: Negligible. The incident represents a local traffic infraction and does not impact state authority, electoral processes, or core government operations.
- Economic security: Negligible. While involving a commercial AI product, a single driving error does not threaten strategic industries, technological competitiveness, or national economic stability.
- Societal stability: Negligible. A minor traffic safety incident does not threaten social cohesion, civil liberties, or population-scale stability.