Google Books Appears to Be Indexing Works Written by AI

Google Books has been found to index low-quality, AI-generated books, identified by common chatbot phrases like 'as of my last knowledge update.' This practice threatens the integrity of the Google Books database and the accuracy of the Google Ngram Viewer, a tool used by academics to track language evolution. While Google claims current Ngram data is not affected, the presence of AI-generated content in the index poses a risk to future research and data reliability.

Google Books is indexing low-quality, AI-generated books, degrading its database and potentially distorting Google Ngram Viewer's analysis of language trends. This integration of inaccurate or misleading information undermines trust, disseminates poor-quality content, and wastes resources as researchers must spend time clearing up the misinformation.

Source: AI Incident Database

Risk classification

  • Primary risk domain: 3 Misinformation
  • Primary risk subdomain: 3.2 Pollution of information ecosystem and loss of consensus reality

The indexing of low-quality, AI-generated books pollutes the Google Books database, threatening the integrity of academic research tools like Ngram that track shared linguistic reality.

Additional risk subdomains

  • 6.3 Economic and cultural devaluation of human effort: The proliferation of low-quality AI-generated books devalues human authorship and compromises the academic value of published literature.

Causal factors

  • Entity: Human
  • Intent: Intentional
  • Timing: Post-deployment

The incident was primarily caused by humans intentionally publishing AI-generated books to spam the market, and Google's automated systems indexing them.

EU AI Act risk tier

  • Risk tier: 3 Limited Risk

Risk Level 3: The incident involves chatbots (ChatGPT) and AI-generated content (books), which fall under Limited Risk due to transparency and disclosure requirements.

AI system and alleged parties

  • AI system: ChatGPT, unspecified (OpenAI)
  • AI purpose: Writing Assistant; Technical Text Generation
  • Behaviour type: Assistant
  • Alleged developer: Google
  • Alleged deployer: Google Books, Google
  • Alleged harmed parties: Researchers, Google Ngram Viewer, Google Books, General public

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Substantial. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

  • Physical: direct Negligible, indirect Negligible
  • Infrastructure: direct Negligible, indirect Negligible
  • Property: direct Negligible, indirect Negligible
  • Financial: direct Negligible, indirect Negligible
  • Environmental: direct Negligible, indirect Negligible
  • Malicious content: direct Negligible, indirect Negligible
  • Differential treatment: direct Negligible, indirect Negligible
  • Civil rights: direct Negligible, indirect Negligible
  • Democracy: direct Negligible, indirect Negligible
  • Privacy: direct Negligible, indirect Negligible
  • Psychological: direct Negligible, indirect Negligible
  • Epistemic: direct Substantial, indirect Substantial
  • Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Epistemic

Reported: The report explicitly describes epistemic harm through the pollution of the Google Books database with low-quality, AI-generated books.

Directly caused: AI-generated books containing factual limitations and boilerplate chatbot phrases were indexed into Google Books.

Indirectly caused: This pollution threatens the integrity of the Google Ngram Viewer, which academics and linguists rely on to track language evolution.

Inferred additional harm: Future linguistic and academic research using Google Books or Ngram may be corrupted by the inclusion of synthetic, AI-generated language patterns.

People affected

  • Occurrences reported: 1

Potential causes

Management

  • Focus on Index Expansion: Management prioritizes rapid indexing over rigorous data curation.
  • Delayed Risk Mitigation: Proactive measures to protect Ngram from AI pollution were missed.

Technology

  • Automated Text Generation: Generative AI easily creates low-quality books at scale.
  • Inadequate Detection Algorithms: Google Books lacks systems to identify AI-generated phrases.

Data Inputs

  • AI-Generated Book Submissions: Bot-authored books are uploaded directly to Google Books.
  • Scraped Source Material: AI books use scraped online data containing outdated facts.

Human Factors

  • Opportunistic Self-Publishing: Authors publish unedited AI content to profit with minimal effort.

Process and Methods

  • Unvetted Indexing Workflow: Google indexes books automatically without reviewing content quality.

Regulatory Environment

  • Lack of AI Disclosure Mandates: No regulations require publishers to label AI-generated text.

Information quality

  • Classification confidence: High
  • Reason for confidence: The report clearly details the discovery of AI-generated books in Google Books using specific search terms and explains the potential impact on the Ngram tool. While the exact number of AI-generated books is not quantified, the mechanism of the risk is well-explained.
  • Ambiguities identified: The exact number of AI-generated books currently indexed is not specified.

Low-quality, AI-generated books are being indexed by Google Books, threatening the integrity of the database and the Google Ngram Viewer used by academics. While this degrades the quality of linguistic research tools, it has negligible direct national security implications.

  • Overall national security impact: Negligible
  • Scope: Multiple nations
  • Primary target: No clear primary
  • Other affected: Global academic community
  • Alleged perpetrator: Unknown

Threat characteristics

  • Imminence: Long-term. The issue represents a gradual, long-term degradation of academic data quality rather than an immediate national security crisis.
  • Autonomy: Human-controlled. AI was used as a writing tool, but humans made the final decision to publish and submit the books to Google's index.
  • Novelty: Evolved capability. Represents an advancement in how AI-generated content can systematically pollute authoritative historical and linguistic databases.

Impact by dimension

  • Physical security: Negligible. The incident involves digital book indexing and poses no threat to physical systems, critical infrastructure, or human safety.
  • Information security: Negligible. While the incident involves information pollution in academic databases, it does not constitute a coordinated state-sponsored disinformation campaign or intelligence compromise.
  • Sovereignty: Negligible. There is no threat to state authority, territorial control, electoral systems, or core government operations.
  • Economic security: Negligible. The pollution of Google Books and Ngram Viewer does not threaten financial systems, strategic industries, or national technological advantages.
  • Societal stability: Negligible. The incident degrades linguistic research tools but does not threaten social cohesion, civil liberties, or population safety.
Explore in the interactive Incident Tracker