Multiple state wildlife agencies have issued warnings after hunters were cited for violating regulations due to relying on inaccurate AI-generated search results. These AI tools incorrectly cited failed legislative bills as current law. Agencies emphasize that hunters are legally responsible for verifying information through official regulation booklets and websites.
A hunter in Idaho was reportedly cited for hunting a day early after relying on an AI-generated search result that misrepresented state regulations, pulling information from a failed proposal. Wildlife agencies in Idaho, Wyoming, Illinois, and Maine later warned of similar AI errors.
Risk classification
- Primary risk domain: 3 Misinformation
- Primary risk subdomain: 3.1 False or misleading information
The AI system generated false and misleading information by presenting failed legislative bills as active laws, leading a hunter to act on inaccurate beliefs and receive a citation.
Additional risk subdomains
- 7.3 Lack of capability or robustness: The AI system failed to perform reliably when parsing complex, multi-page regulatory documents, leading to errors and hallucinations.
- 5.1 Overreliance and unsafe use: Hunters relied on general-purpose search AI for critical regulatory compliance instead of verifying with official sources.
Causal factors
- Entity: AI
- Intent: Unintentional
- Timing: Post-deployment
The incident was caused by deployed AI search systems generating inaccurate and hallucinated regulatory information, which was an unintentional failure of the system's capabilities post-deployment.
EU AI Act risk tier
- Risk tier: 3 Limited Risk
Risk Level 3: The systems described are search engine chatbots and AI-generated overviews. According to the definitions, 'AI systems that pose a moderate risk and require specific transparency obligations... such as notifying users when they are interacting with an AI system or when AI-generated content is being used' fall under Risk Level 3.
AI system and alleged parties
- AI system: Google AI-generated search overviews (Google)
- AI purpose: Question Answering; Content Search
- Behaviour type: Assistant
- Alleged developer: Google
- Alleged deployer: Google
- Alleged harmed parties: Wyoming Game and Fish Department, Unnamed hunter in Idaho, State wildlife agencies, Idaho Fish and Game, Hunters, Epistemic integrity
Harm severity
Severity ratings are based on this scale.
Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
- Physical: direct Negligible, indirect Negligible
- Infrastructure: direct Negligible, indirect Negligible
- Property: direct Negligible, indirect Negligible
- Financial: direct Negligible, indirect Negligible
- Environmental: direct Negligible, indirect Negligible
- Malicious content: direct Negligible, indirect Negligible
- Differential treatment: direct Negligible, indirect Negligible
- Civil rights: direct Negligible, indirect Negligible
- Democracy: direct Negligible, indirect Negligible
- Privacy: direct Negligible, indirect Negligible
- Psychological: direct Negligible, indirect Negligible
- Epistemic: direct Minor, indirect Minor
- Child sexual exploitation and abuse: direct Negligible, indirect Negligible
Epistemic
Reported: Yes, the report describes AI search engines generating inaccurate and misleading information by presenting failed legislative bills as current laws.
Directly caused: Google Search AI Overviews generated incorrect summaries of hunting regulations, misinterpreting failed bills as active laws and providing wrong opening dates.
Indirectly caused: The dissemination of false regulatory information led to public confusion and undermined the authority of official state wildlife guidelines.
Inferred additional harm: Widespread erosion of trust in online search results for legal and regulatory information as users realize AI overviews can fabricate active laws.
People affected
- Occurrences reported: 3
- People reportedly harmed: 1
- People reportedly exposed: 5
Potential causes
Management
- Rapid AI Deployment Without Guardrails: Search engines deployed AI overviews before ensuring accuracy on legal matters.
Technology
- AI Hallucination and Source Confusion: AI pulled rules from a similar river in Arkansas instead of Idaho.
- Inability to Parse Complex Rules: AI gets overwhelmed by complex, multi-page hunting regulation booklets.
Data Inputs
- Inclusion of Failed Legislative Bills: AI scraped failed proposals from legislative sites and treated them as law.
- Lack of Contextual Data Labeling: Failed bills and active laws were not distinct enough for the AI to discern.
Human Factors
- Overreliance on AI Search Results: Users relied on quick AI summaries instead of verifying with official booklets.
- Habitual Search Engine Usage: Hunters carried daily Google habits into complex hunting regulation searches.
Process and Methods
- Lack of Direct Source Verification: Users bypassed checking the official Game and Fish agency website or booklets.
- Ineffective AI Disclaimers: Disclaimers urging users to verify information were ignored or ineffective.
Information quality
- Classification confidence: High
- Reason for confidence: The reports from official state wildlife agencies and reputable news sources clearly document the specific failure mode (AI misinterpreting failed bills as law) and the resulting real-world harm (a hunter receiving a citation). There is no conflicting information, and the role of Google Search AI Overviews is explicitly discussed.
- Ambiguities identified: The exact number of hunters cited overall is not fully quantified, referred to generally as 'people' or 'a handful of examples'.
- Alternative interpretations: None. The cause-and-effect relationship between the AI's incorrect output and the hunter's regulatory violation is clear.
Inaccurate AI-generated search results led to minor hunting regulation violations and citations in several US states. The incident represents a minor consumer-level AI hallucination issue with negligible national security implications.
- Overall national security impact: Negligible
- Scope: Single nation
- Primary target: United States
- Alleged perpetrator: Unknown
Threat characteristics
- Imminence: Long-term. Represents an ongoing consumer search reliability issue rather than an active national security crisis.
- Autonomy: Human-controlled. The AI tool acts as an informational search assistant, with humans retaining full control over final actions and compliance decisions.
- Novelty: Established threat. AI hallucinations and inaccurate search engine summaries are well-documented, established technical limitations.
Impact by dimension
- Physical security: Negligible. No threat to physical systems, critical infrastructure, or human safety was identified in this incident.
- Information security: Negligible. The incident involved unintentional search engine hallucinations rather than coordinated disinformation or intelligence compromise.
- Sovereignty: Negligible. No threat to state authority, territorial control, or core government decision-making processes.
- Economic security: Negligible. Economic impact is limited to minor individual hunting fines, representing no threat to national economic or technological security.
- Societal stability: Negligible. The incident does not pose any threat to social cohesion, civil liberties, or population safety.