Nest Smoke Alarm Erroneously Stops Alarming

In testing, Google Nest engineers demonstrated that the Nest Wave feature of their Nest Protect: Smoke + CO Alarm could inadvertently silence genuine alarms.

Risk classification

• Primary risk domain: 7 AI system safety, failures, & limitations
• Primary risk subdomain: 7.3 Lack of capability or robustness

The incident was caused by a technical bug in the Nest Wave gesture-recognition algorithm, representing a lack of capability and robustness in critical safety-critical software.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The safety risk was caused by a glitch in the AI motion-sensing algorithm of the deployed Nest Protect device, which unintentionally threatened to silence the alarm during a real fire.

EU AI Act risk tier

• Risk tier: 2 High Risk

High Risk: The Nest Protect is an AI-system integrated into critical home safety infrastructure. According to the definitions, High Risk includes 'AI systems that have significant implications for safety' and those used in critical safety applications.

AI system and alleged parties

• AI system: Nest Protect (Nest Labs)
• AI purpose: Smart Devices; Threat Detection
• Behaviour type: Autonomous
• Alleged developer: Nest Labs
• Alleged deployer: Nest Labs
• Alleged harmed parties: Fire Victims

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Minor
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Psychological

Reported: The report explicitly describes some users experiencing distress and panic due to unprompted false alarms from the Nest Protect units.

Indirectly caused: One customer reported that their family was scared and evacuated their home at midnight due to a persistent false alarm that could not be silenced.

People affected

• Occurrences reported: 1
• People reportedly exposed: 440000

Potential causes

Management

• Prioritizing Convenience Over Safety: Rushing the gesture-silence feature without fully assessing safety risks.

Technology

• Algorithmic Bug in Nest Wave: Algorithm misinterpreted normal activity near device as a wave gesture.
• Wi-Fi Dependency for Updates: Unconnected devices could not receive the critical safety firmware update.
• Hardware Sensor Malfunctions: Reports of false alarms due to hardware issues that could not be silenced.

Data Inputs

• Ambiguous Motion Data Inputs: Environmental movement near detector was registered as a silence command.
• Lack of Physical Verification: The system relied on motion data without verifying the presence of smoke.

Human Factors

• Unconnected Devices: Users did not connect the smoke detector to Wi-Fi, preventing updates.
• Accidental Gesture Triggers: Inadvertent human movement near the device could silence a real alarm.

Process and Methods

• Inadequate Lab Testing Initially: The gesture algorithm defect was only discovered in later laboratory tests.
• Flawed Feature Design: Designing a safety-critical silence feature based purely on movement.

Regulatory Environment

• Delayed Official Recall Process: CPSC took weeks to approve and officially publish Nest's voluntary remedy.

Information quality

• Classification confidence: High
• Reason for confidence: The reports provide clear, consistent, and detailed accounts of the technical glitch, the number of affected units (440,000), the company's response, and the lack of real-world physical harm. Multiple reputable sources confirm these facts.

A technical glitch in Nest Protect's gesture-recognition algorithm created a potential safety hazard by incorrectly silencing smoke alarms. While highlighting the risks of embedding AI into safety-critical consumer hardware, the incident was quickly resolved via a firmware update and had negligible implications for national security.

• Overall national security impact: Negligible
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. The issue was resolved via a firmware update in 2014, representing no active or near-term threat to national security.
• Autonomy: Full autonomy. The device's motion-sensing algorithm autonomously decided to silence alarms based on environment inputs without human intervention.
• Novelty: Evolved capability. The integration of gesture-recognition algorithms into critical life-safety consumer hardware represented a significant evolution in smart home tech.

Impact by dimension

• Physical security: Negligible. The incident involved consumer smart home smoke detectors, not critical national infrastructure, and resulted in no reported physical injuries or deaths.
• Information security: Negligible. There was no compromise of intelligence capabilities, classified data, or information warfare operations associated with this software bug.
• Sovereignty: Negligible. The incident was a commercial product safety recall and did not impact state authority, border control, or government decision-making.
• Economic security: Negligible. While Nest Labs faced financial recall costs, the event posed no threat to national economic stability, strategic industries, or technological dominance.
• Societal stability: Negligible. The software bug caused minor consumer distress due to false alarms but did not threaten social cohesion, civil liberties, or human rights.