DuckDuckGo Search Assist Reportedly Falsely Claimed Donald Trump and JD Vance Died of Rabies

DuckDuckGo's Search Assist reportedly produced an answer stating that Donald Trump and JD Vance had died of rabies and repeated fabricated details involving Robert F. Kennedy Jr. The answer cited a false WKNA49 article alongside an unrelated ABC News report. Reporting linked the episode to adversarial web content associated with r/poisonai. DuckDuckGo said Search Assist had been "deliberately tricked," fixed the result, and planned updates.

Risk classification

• Primary risk domain: 3 Misinformation
• Primary risk subdomain: 3.1 False or misleading information

The AI systems inadvertently generated and spread false information about the deaths of political figures, which could lead to inaccurate beliefs in users.

Additional risk subdomains

• 7.3 Lack of capability or robustness: The AI search engines failed to perform robustly by failing to verify sources and cross-reference claims, making them vulnerable to data poisoning.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The incident was caused by the AI search engines generating and presenting false information as fact, which was an unexpected and unintentional outcome of their deployment.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The report describes AI chatbots and search assistants generating text content, which fall under transparency obligations to ensure users are aware they are interacting with AI.

AI system and alleged parties

• AI system: Brave Search AI, Search Assist (Brave, DuckDuckGo)
• AI purpose: Question Answering; Content Search
• Behaviour type: Assistant
• Alleged developer: DuckDuckGo, AI search technology developers
• Alleged deployer: DuckDuckGo
• Alleged harmed parties: Robert F. Kennedy Jr., public figures, JD Vance, General public of the United States, General public, Epistemic integrity, Elected officials, Donald Trump

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Minor, indirect Minor
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Epistemic

Reported: Yes, the reports describe AI-driven misinformation where search engines fabricated and spread false claims about the deaths of Donald Trump and JD Vance.

Directly caused: DuckDuckGo and Brave AI search engines generated and displayed false summaries claiming Trump and Vance died of rabies, citing a fake news site and an unrelated ABC News article.

Indirectly caused: The spread of this false information on social media and Reddit, potentially confusing users who did not verify the sources.

Inferred additional harm: Potential erosion of trust in AI-powered search engines and the broader information ecosystem as users realize these systems can easily be tricked by coordinated pranks.

People affected

• Occurrences reported: 1

Potential causes

Management

• Deflecting Quality Responsibility: Brave management shifted the entire burden of fact-checking onto end users.
• Premature AI Search Deployment: Deploying AI search features before establishing robust data-trust measures.

Technology

• AI Hallucination and Synthesis: AI merged unrelated ABC News rabies article with false Trump claims.
• Weak Source Verification: Search systems failed to verify if cited sources actually backed the claim.
• Authoritative Tone of LLMs: AI presented unverified, false information in a highly confident manner.

Data Inputs

• Deliberate Data Poisoning: Reddit community r/poisonAI coordinated to flood the web with fake stories.
• Pink Slime Web Scraping: AI scraped automated pink-slime news sites that laundered Reddit rumors.
• Keyword-Based Association: AI pulled an unrelated ABC News rabies article based purely on keyword match.

Human Factors

• User Overreliance on AI: Users trust AI summaries and links without opening them to verify content.
• Coordinated Prankster Campaigns: Reddit users actively worked to trick AI systems into spreading rumors.

Process and Methods

• Lack of Fact-Checking Filters: Search engines did not run cross-checks with reputable independent media.
• Inadequate Satire Detection: AI algorithms struggled to distinguish online sarcasm and satire from reality.

Regulatory Environment

• Lack of Pink-Slime Regulation: No standard regulations to prevent automated fake news sites from operating.

Information quality

• Classification confidence: High
• Reason for confidence: The reports provide consistent, detailed accounts of the incident across multiple sources (Futurism, Tom's Guide, Mimikama), including screenshots, official statements from Brave and DuckDuckGo, and the specific mechanics of the r/poisonai subreddit and the WKNA 49 pink slime website.
• Alternative interpretations: The incident could be viewed purely as a successful data-poisoning experiment/prank rather than an AI safety failure, though the AI's failure to verify sources is the core safety issue.

A coordinated data-poisoning campaign by a Reddit community successfully manipulated DuckDuckGo and Brave's AI search features into falsely reporting the deaths of high-profile US political figures. While the incident was a prank with negligible direct national security impact, it highlights an evolved vulnerability in real-time AI information retrieval systems that could be exploited for targeted information operations.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Reddit community r/poisonai

Threat characteristics

• Imminence: Long-term. The specific incident was quickly mitigated by the vendors, representing an ongoing, long-term strategic vulnerability rather than an active crisis.
• Autonomy: Human-supervised. The AI search systems autonomously retrieved and synthesized poisoned web data, but operated within commercial platforms subject to human oversight and user verification.
• Novelty: Evolved capability. Represents an evolved application of data-poisoning techniques specifically targeting real-time Retrieval-Augmented Generation (RAG) search engines.

Impact by dimension

• Physical security: Negligible. No physical systems, critical infrastructure, or human safety were threatened or impacted by this incident.
• Information security: Minor. Demonstrates a successful data-poisoning vulnerability where coordinated online actors manipulated commercial AI search engines to spread false narratives about political figures, though conducted as a prank rather than state-sponsored warfare.
• Sovereignty: Negligible. No disruption to core government operations, electoral systems, or constitutional processes occurred.
• Economic security: Negligible. No significant economic impact, financial market disruption, or strategic technology theft was reported.
• Societal stability: Negligible. Did not cause civil unrest, mass surveillance, or human rights violations, resulting only in minor and temporary epistemic confusion.