California SB 892 (Public contracts: automated decision systems: procurement standards)

Directs the Department of Technology to develop and adopt ADS procurement regulations, emphasizing risk assessments, equity analysis, and data minimization. Prohibits state agencies from procuring ADS without these regulations effective January 1, 2027. Requires ongoing regulatory reviews and vendor compliance.

  • Authority: California
  • Parent authority: State governments
  • Jurisdiction: United States
  • Collections: U.S. state and local documents
  • Most recent activity: Defunct
  • Most recent activity date: 2024-11-30

Risk subdomain coverage

Good coverage — Comprehensive governance measures or mitigations with clear procedures relating to the risk subdomain are explicitly described.

  • Unfair discrimination and misrepresentation
  • Unequal performance across groups
  • Compromise of privacy
  • Loss of human agency and autonomy
  • Governance failure
  • Lack of capability or robustness
  • Lack of transparency or interpretability

Minimal coverage — Brief mention but no specific mitigations, recommendations or governance measures relating to the risk subdomain are described.

  • AI system security vulnerabilities
  • False or misleading information
  • Disinformation, surveillance, and influence at scale
  • Fraud, scams, and targeted manipulation
  • Overreliance and unsafe use

All other risk subdomains had no coverage in this document.

Risk Coverage Summary

The document has good coverage of approximately 8-10 subdomains, with strong focus on discrimination and fairness (1.1, 1.3), privacy protection (2.1), AI system security and robustness (2.2, 7.3), transparency and interpretability (7.4), governance structures (6.5), and human oversight (5.2). Coverage is concentrated in fairness, transparency, and system reliability domains.

Sector coverage

Good coverage — Comprehensive governance measures or mitigations with clear procedures relating to the sector are explicitly described.

  • Public Administration (excl. National Security)

Minimal coverage — Brief mention but no specific mitigations, recommendations or governance measures relating to the sector are described.

  • Information
  • Professional & Technical Services
  • Scientific Research & Development Services
  • Health Care & Social Assistance

All other sectors had no coverage in this document.

Sectors Summary

This document primarily governs Public Administration (excluding National Security) as it regulates California state agency procurement of automated decision systems. The governance applies across all sectors where state agencies operate and deploy ADS, but the direct regulatory target is government procurement processes.

Legislative Status

Hard Law

Legislative Status Summary

This is a binding California state statute with mandatory language, enforcement mechanisms, and legal obligations on state agencies regarding ADS procurement.

Actors

Proposer

  • Entity Types: AI_Governance_Actor
  • Entities: California State Legislature; People of the State of California
  • Summary: The document is a California state bill enacted by the state legislature, as indicated by the opening phrase 'The people of the State of California do enact as follows' and the bill designation 'California SB 892'.

Target

  • Entity Types: AI_Governance_Actor, AI_Deployer
  • Entities: California state agencies; ADS vendors
  • Summary: The document explicitly targets state agencies that procure automated decision systems and the vendors that provide these systems. State agencies are prohibited from procuring ADS without compliance, and vendors must meet specific contractual requirements.

Enforcer

  • Entity Types: AI_Governance_Actor
  • Entities: Department of Technology; California Privacy Protection Agency
  • Summary: The Department of Technology is designated as the primary enforcement body responsible for developing and adopting ADS procurement regulations. The California Privacy Protection Agency is consulted to ensure regulatory alignment.

Monitor

  • Entity Types: AI_Governance_Actor
  • Entities: Department of Technology
  • Summary: The Department of Technology is explicitly required to conduct annual reviews and updates of the ADS procurement standard and regulations, establishing ongoing monitoring responsibilities.

AI Lifecycle Stages

Lifecycle stages covered by the documents, as defined in the OECD Framework for the Classification of AI Systems

  • Plan and Design
  • Collect and Process Data
  • Verify and Validate
  • Deploy
  • Operate and Monitor

AI Lifecycle Summary

The document primarily focuses on the procurement and deployment stages of AI systems, with significant coverage of verification/validation requirements and operational monitoring. It addresses planning through risk assessment requirements but does not explicitly cover data collection or model building stages.

Technical Scope

Terms relating to technical scope that are mentioned or implicitly referenced in the document

  • AI Systems

Technical Scope Summary

The document explicitly defines and covers 'Automated Decision Systems' (ADS) and 'Artificial Intelligence' (AI). It does not mention frontier AI, general purpose AI, foundation models, generative AI, predictive AI, open-weight models, or compute thresholds. The focus is on AI systems used for decision-making in government procurement contexts.

https://leginfo.legislature.ca.gov/faces/billNavClient.xhtml?bill_id=202320240SB892
https://agora.eto.tech/instrument/4087
Explore in the Document View

Document data from AGORA, CSET Emerging Technology Observatory.