Attorney in Fletcher v. Experian Information Solutions, Inc. Reportedly Submitted Reply Brief with Purportedly AI-Generated Material Misrepresentations

In Fletcher v. Experian Information Solutions, Inc., the Fifth Circuit found that attorney Heather Hersh had used generative AI to draft a substantial portion of a reply brief that contained fabricated legal support and factual representations. The court first issued a show-cause order and later imposed a $2,500 sanction, linking the filing errors to unverified AI-generated output.

Risk classification

• Primary risk domain: 3 Misinformation
• Primary risk subdomain: 3.1 False or misleading information

The AI system generated 21 instances of fabricated case citations and factual misrepresentations, which constitutes false or misleading information that misled the user and was submitted to a court.

Additional risk subdomains

• 5.1 Overreliance and unsafe use: The attorney overrelied on the AI system by failing to verify the accuracy of the generated legal citations before submitting them to the court.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The incident was initiated by the AI system generating fabricated citations (hallucinations) during its post-deployment use, which was an unintentional outcome of the generation process.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The system used was a generative AI writing assistant or chatbot, which falls under transparency obligations to ensure users are aware of the AI's nature and verify its outputs.

AI system and alleged parties

• AI system: generative AI
• AI purpose: Writing Assistant; Technical Text Generation
• Behaviour type: Assistant
• Alleged developer: Unknown large language model developers
• Alleged deployer: Heather Hersh
• Alleged harmed parties: United States Court of Appeals for the Fifth Circuit, Judicial integrity, James Fletcher, Experian Information Solutions, Inc., Epistemic integrity

Harm severity

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Minor, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Epistemic

Reported: The report explicitly describes epistemic harm in the form of 21 fabricated quotations and serious misrepresentations of law or fact generated by AI.

Directly caused: The AI system fabricated 21 legal citations and quotations, which were then submitted in a formal court brief, polluting the legal information environment.

Indirectly caused: The court's time and resources were wasted addressing and verifying the 21 fabricated citations.

Inferred additional harm: N/A

People affected

• Occurrences reported: 1
• People reportedly harmed: 1
• People reportedly exposed: 4

Potential causes

Management

• Inadequate Ethical Oversight: Lack of firm oversight led to the submission of unverified legal briefs.

Technology

• AI Hallucination of Case Citations: Generative AI drafted a brief with 21 fabricated quotations and cases.

Human Factors

• Failure to Verify AI Output: The attorney did not check the accuracy of the AI-generated citations.
• Misleading the Court: The attorney falsely blamed databases and evaded admitting she used AI.

Process and Methods

• Lack of Verification Process: No process was in place to verify the authenticity of legal citations.

Regulatory Environment

• Absence of AI-Specific Rules: The court opted against adopting rules regulating generative AI use.

Information quality

• Classification confidence: High
• Reason for confidence: The report provides clear, factual details about the court proceedings, the specific attorney sanctioned, the exact amount of the fine ($2,500), and the number of fabricated citations (21). The role of the AI in generating the hallucinations is explicitly stated.
• Ambiguities identified: The specific AI model or platform used by the attorney is not identified in the report.
• Alternative interpretations: None. The facts of the AI hallucination and subsequent court sanction are clear and uncontested.

A federal appeals court sanctioned an attorney $2,500 for submitting a legal brief containing 21 AI-generated fabricated case citations. This incident represents a domestic professional conduct and AI-reliance issue with negligible implications for national security.

• Overall national security impact: Negligible
• Response level: Minor
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Attorney Hersh

Threat characteristics

• Imminence: Long-term. This reflects an ongoing, systemic challenge of generative AI use in professional fields rather than an active national security crisis.
• Autonomy: Human-controlled. The AI was used as a drafting assistant, and the final decision to submit the brief rested entirely with the human attorney.
• Novelty: Established threat. AI hallucinations in legal filings are well-documented, with hundreds of similar cases previously recorded in the United States.

Impact by dimension

• Physical security: Negligible. The incident is a domestic legal filing issue with no impact on physical systems, infrastructure, or human safety.
• Information security: Negligible. While it involves AI-generated misinformation, it was an unintentional error by a domestic attorney in a court brief, not a hostile foreign disinformation campaign.
• Sovereignty: Negligible. The incident represents a routine professional conduct issue within the domestic judicial system, easily managed under existing court rules with no threat to state authority.
• Economic security: Negligible. The economic impact is limited to a minor $2,500 court sanction against an individual attorney, posing no threat to strategic industries or economic stability.
• Societal stability: Negligible. No mass surveillance, systematic discrimination, or threat to social cohesion was reported. It is an isolated case of professional negligence.