Amazon Rife with Many Allegedly AI-Generated Books of Suspect Quality

Amazon’s Kindle Unlimited young adult romance bestseller list was flooded with allegedly AI-generated books that made little to no sense, disrupting the rankings. These books were reported to be "clearly there to click farm." Despite being removed from the bestseller list, many remained available for purchase. The incident raised concerns about the integrity of the platform, and the potential financial impact on legitimate authors.

Risk classification

• Primary risk domain: 6 Socioeconomic & Environmental
• Primary risk subdomain: 6.3 Economic and cultural devaluation of human effort

The flood of AI-generated books directly displaced legitimate human authors from bestseller lists and threatened to dilute the financial compensation pool for human writers, devaluing their creative effort.

Additional risk subdomains

• 4.3 Fraud, scams, and targeted manipulation: The AI-generated books were used as part of a click-farming scheme to fraudulently monetize Kindle Unlimited pages read.
• 3.2 Pollution of information ecosystem and loss of consensus reality: The influx of dozens of nonsense books polluted the Kindle Unlimited marketplace and corrupted the integrity of the bestseller charts.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The incident was caused by human actors intentionally deploying AI text generation tools to create nonsense books and exploit Amazon's monetization system post-deployment.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The incident involves AI-generated text content (books) published on a commercial platform without clear disclosure, which relates to transparency obligations for AI-generated content under the EU AI Act.

AI system and alleged parties

• AI system: AI bots
• AI purpose: Writing Assistant
• Behaviour type: unknown
• Alleged developer: unknown
• Alleged deployer: unknown
• Alleged harmed parties: Authors, Amazon Customers, Amazon

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Minor, indirect Minor
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Epistemic

Reported: Yes, the report describes the generation and publication of dozens of AI-generated nonsense books that flooded the bestseller list.

Directly caused: Dozens of AI-generated books filled with nonsense (e.g., 'Apricot bar code architecture') were published and reached the top 100 bestseller list on Amazon.

Indirectly caused: The presence of these books degraded the reliability of Amazon's bestseller charts, making it difficult for users to find genuine human-authored books.

Inferred additional harm: We infer that readers who purchased or downloaded these books were misled into consuming low-quality, nonsensical AI-generated content.

People affected

• Occurrences reported: 1
• People reportedly harmed: 2
• People reportedly exposed: 100

Potential causes

Management

• Vulnerable KENP Payout Scheme: Payout model incentivized click farming of AI books.

Technology

• Vulnerable Bestseller Algorithm: Algorithm allowed AI-generated nonsense to dominate the top 100 list.
• Ineffective Click Farm Detection: Amazon failed to detect and block automated click farms.

Data Inputs

• AI-Generated Nonsense Content: Dozens of gibberish books were uploaded to Kindle Unlimited.

Human Factors

• Spammer Financial Motivation: Actors sought to monetize AI-generated books via click farming.

Process and Methods

• Reactive Investigation Process: Amazon investigates only after a concern is raised by users.

Information quality

• Classification confidence: Medium
• Reason for confidence: The report clearly documents the disruption of Amazon's bestseller list by AI-generated books and the potential economic threat to indie authors. However, it lacks technical details about the specific AI systems used to generate the books or the exact scale of the click-farming operation.
• Ambiguities identified: The exact mechanism of the click-farming operation and the specific AI models used to generate the books are not specified.
• Alternative interpretations: The incident could be viewed primarily as a platform abuse/spam issue rather than an AI safety failure, though the scale of the spam was enabled by generative AI.

An exploit of Amazon's Kindle Unlimited payout system using AI-generated nonsense books to click-farm royalties. While economically damaging to individual indie authors, the incident is a commercial platform abuse issue with negligible national security implications.

• Overall national security impact: Negligible
• Scope: Multiple nations
• Primary target: No clear primary
• Other affected: Multiple nations
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. The incident represents a platform abuse issue rather than an active national security crisis requiring urgent governmental response.
• Autonomy: Human-controlled. The AI was used as a tool to generate text, while humans directed the creation, upload, and monetization strategies.
• Novelty: Evolved capability. Represents an advancement of traditional book-spamming and click-farming techniques through the integration of generative AI text tools.

Impact by dimension

• Physical security: Negligible. The incident involves digital book spam on a commercial e-commerce platform and presents no threat to physical systems, critical infrastructure, or human safety.
• Information security: Negligible. While the incident involved the generation of nonsense text, it was aimed at commercial platform exploitation rather than state-sponsored disinformation or intelligence compromise.
• Sovereignty: Negligible. There is no impact on state authority, territorial control, electoral systems, or core government operations.
• Economic security: Negligible. The financial impact is limited to independent authors and Amazon's Kindle Unlimited platform. It does not threaten national economic stability, strategic industries, or critical supply chains.
• Societal stability: Negligible. The incident does not involve mass surveillance, systematic discrimination, civil unrest, or threats to human rights.