Regulates the use of AI for utilization review and management by health care service plans and disability insurers. Ensures AI tools base decisions on individual clinical circumstances, do not replace provider judgment, and are open for audit. Prohibits AI from denying care based on medical necessity without human oversight.
Good coverage — Comprehensive governance measures or mitigations with clear procedures relating to the risk subdomain are explicitly described.
Minimal coverage — Brief mention but no specific mitigations, recommendations or governance measures relating to the risk subdomain are described.
All other risk subdomains had no coverage in this document.
Risk Coverage Summary
The document has good coverage of approximately 5-6 subdomains, with strong focus on unfair discrimination (1.1, 1.3), privacy compromise (2.1), lack of transparency (7.4), and lack of robustness (7.3). Coverage is concentrated in discrimination/toxicity, privacy, and AI system safety domains, specifically addressing risks in healthcare AI utilization review systems.
Good coverage — Comprehensive governance measures or mitigations with clear procedures relating to the sector are explicitly described.
Minimal coverage — Brief mention but no specific mitigations, recommendations or governance measures relating to the sector are described.
All other sectors had no coverage in this document.
Sectors Summary
The document exclusively governs the Health Care and Social Assistance sector, specifically regulating health care service plans and disability insurers that use AI for utilization review and management functions. No other economic sectors are governed by this legislation.
Hard Law
Legislative Status Summary
This is a binding California state statute with mandatory requirements, enforcement mechanisms including administrative penalties, and regulatory oversight by state departments.
Proposer
Target
Enforcer
Monitor
Lifecycle stages covered by the documents, as defined in the OECD Framework for the Classification of AI Systems
AI Lifecycle Summary
The document primarily focuses on the Deploy and Operate and Monitor stages of the AI lifecycle, with specific requirements for how AI tools must be implemented in utilization review systems and ongoing oversight requirements. There is minimal coverage of earlier stages like planning, data collection, or model building.
Terms relating to technical scope that are mentioned or implicitly referenced in the document
Technical Scope Summary
The document explicitly mentions AI systems through references to 'artificial intelligence, algorithm, or other software tool' used for utilization review. It provides a definition of artificial intelligence and focuses on task-specific AI applications in healthcare utilization management. There is no mention of frontier AI, general purpose AI, foundation models, generative AI, open-weight models, or compute thresholds.
Document data from AGORA, CSET Emerging Technology Observatory.