Lawyers in Lexos Media IP LLC v. Overstock.com Inc. Sanctioned Over Court-Identified AI-Generated Citations

In Lexos Media IP LLC v. Overstock.com Inc., a Kansas federal judge sanctioned five lawyers after finding that filings included AI-generated defective legal authority that had not been verified before submission. The lawyers were fined $12,000 combined.

Risk classification

• Primary risk domain: 5 Human-Computer Interaction
• Primary risk subdomain: 5.1 Overreliance and unsafe use

The lawyers overrelied on ChatGPT by using it for legal research and submitting its unverified, hallucinated outputs directly to a federal court without checking them for accuracy.

Additional risk subdomains

• 3.1 False or misleading information: The AI system generated false and misleading information in the form of non-existent legal citations and quotations.

Causal factors

• Entity: AI
• Intent: Unintentional
• Timing: Post-deployment

The incident was initiated by the AI system generating hallucinated, non-existent legal citations, which is an unintentional outcome of using the model for legal research.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: ChatGPT is a general-purpose chatbot and generative AI system, which falls under Risk Level 3 due to transparency obligations for conversational systems and synthetic content.

AI system and alleged parties

• AI system: ChatGPT (OpenAI)
• AI purpose: Writing Assistant; Technical Text Generation
• Behaviour type: Assistant
• Alleged developer: OpenAI, Large language model developers, Chatbot developers, AI research tool developers
• Alleged deployer: SethLaw PLLC, Sandeep Seth, Lawyers, Law firms
• Alleged harmed parties: United States District Court for the District of Kansas, Overstock.com, Judicial integrity, Epistemic integrity

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Minor, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Minor, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Financial

Reported: The report explicitly describes financial losses in the form of court-ordered fines totaling $12,000 imposed on the sanctioned lawyers.

Directly caused: A total of $12,000 in fines was directly imposed on the lawyers, averaging $12,000 for this single occurrence of the incident.

Epistemic

Reported: The report explicitly describes epistemic harm through the generation and submission of hallucinated legal citations and quotations to a federal court.

Directly caused: The AI system generated fictional legal citations and quotations which were then included in official court filings, corrupting the legal record.

People affected

• Occurrences reported: 1
• People reportedly harmed: 5
• People reportedly exposed: 5

Potential causes

Management

• Absence of Firm AI Policies: The law firm operated without strict policies governing the use of AI tools.
• Inadequate Partner Supervision: Management failed to ensure all signing attorneys vetted the submitted filings.

Technology

• AI Hallucination: The generative AI tool fabricated non-existent legal citations and quotes.
• Unreliable AI Research Tools: Generative AI can produce plausible but entirely fictional legal authorities.

Data Inputs

• Unverified AI Outputs: AI-generated text was directly input into court filings without verification.

Human Factors

• Failure to Verify Citations: Lawyers signed and filed documents without checking citations for accuracy.
• Personal Pressures: The primary attorney used ChatGPT under personal pressure, bypassing checks.
• Negligent Document Signing: Co-counsel and local counsel signed documents without reviewing the content.

Process and Methods

• Inadequate Review Process: The firm lacked a process to cross-reference and verify legal citations.

Regulatory Environment

• Lack of Standardized AI Rules: Courts rely on retroactive sanctions rather than proactive AI usage standards.

Information quality

• Classification confidence: High
• Reason for confidence: The report provides clear, unambiguous details regarding the specific AI tool used, the nature of the failure (hallucinations), the parties involved, and the exact financial penalties imposed by the court.

Five lawyers were sanctioned by a Kansas federal judge for submitting court filings containing non-existent case citations generated by ChatGPT. This incident represents a localized failure of professional ethics and AI verification with negligible national security implications, as it posed no threat to physical infrastructure, intelligence, sovereignty, the economy, or societal stability.

• Overall national security impact: Negligible
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Lexos Media IP attorneys

Threat characteristics

• Imminence: Long-term. This represents an ongoing professional ethics and AI integration challenge rather than an active national security crisis.
• Autonomy: Human-controlled. The AI served as a writing assistant, and humans retained final authority and responsibility for submitting the filings.
• Novelty: Established threat. Lawyers submitting ChatGPT-hallucinated case citations is a well-publicized issue with multiple prior occurrences in the US legal system.

Impact by dimension

• Physical security: Negligible. No physical systems, infrastructure, or human safety was threatened or impacted by this incident.
• Information security: Negligible. The incident involved unintentional legal hallucinations in a routine civil lawsuit, with no intelligence compromise or systematic disinformation campaign.
• Sovereignty: Negligible. While occurring in a federal court, the incident had no impact on core government operations or sovereignty, and was easily managed via standard judicial sanctions.
• Economic security: Negligible. No threat to financial stability, strategic industries, or technological competitive advantage. The $12,000 fine has negligible economic impact.
• Societal stability: Negligible. No threat to social cohesion, civil liberties, or population safety. The incident was a localized professional ethics failure.