Safe and Secure Innovation for Frontier Artificial Intelligence Models Act (SB 1047)

• Authority: California
• Parent authority: State governments
• Jurisdiction: United States
• Collections: Editors' Picks;U.S. state and local documents
• Most recent activity: Defunct
• Most recent activity date: 2024-09-30

Risk subdomain coverage

Good coverage — Comprehensive governance measures or mitigations with clear procedures relating to the risk subdomain are explicitly described.

• AI system security vulnerabilities
• Cyberattacks, weapon development or use
• Competitive dynamics
• Governance failure
• AI pursuing its own goals
• AI possessing dangerous capabilities
• Lack of capability or robustness
• Lack of transparency or interpretability

Minimal coverage — Brief mention but no specific mitigations, recommendations or governance measures relating to the risk subdomain are described.

• Compromise of privacy
• Disinformation, surveillance, and influence at scale
• Fraud, scams, and targeted manipulation
• Loss of human agency and autonomy
• Power centralization and unfair distribution

All other risk subdomains had no coverage in this document.

Risk Coverage Summary

The document has good coverage of approximately 10-12 subdomains, with strong focus on malicious actors (4.1, 4.2, 4.3), AI system security (2.2), competitive dynamics (6.4), governance failure (6.5), and AI safety failures (7.1, 7.2, 7.3). Coverage is concentrated in security, misuse prevention, and AI safety domains, with particular emphasis on preventing critical harms from frontier AI models.

Sector coverage

Good coverage — Comprehensive governance measures or mitigations with clear procedures relating to the sector are explicitly described.

• Information
• Scientific Research & Development Services
• Public Administration (excl. National Security)

Minimal coverage — Brief mention but no specific mitigations, recommendations or governance measures relating to the sector are described.

• Trade, Transportation & Utilities
• Professional & Technical Services
• Educational Services
• Health Care & Social Assistance
• National Security

All other sectors had no coverage in this document.

Sectors Summary

This legislation primarily governs the Information sector (AI developers, cloud computing providers, data processing) and Scientific Research and Development Services sector (AI research institutions, universities conducting AI research). It also has implications for the Professional and Technical Services sector through third-party auditing requirements. The CalCompute initiative specifically targets academic research institutions within Educational Services.

Legislative Status

Hard Law

Legislative Status Summary

This is a binding legislative act (SB 1047) with mandatory obligations, civil penalties for violations, enforcement by the Attorney General, and detailed compliance requirements including audits, reporting, and safety protocols.

Actors

Proposer

• Entity Types: AI_Governance_Actor
• Summary: This is a legislative act (SB 1047) proposed and enacted by the California State Legislature, as indicated by the bill number and legislative findings.

Target

• Entity Types: AI_Developer, AI_Infrastructure_Provider
• Summary: The act explicitly targets developers of covered models (frontier AI models meeting specific compute thresholds) and operators of computing clusters. These are defined as entities that train AI models using specified amounts of computing power or operate data centers capable of training such models.

Enforcer

• Entity Types: AI_Governance_Actor
• Summary: The Attorney General has primary enforcement authority with power to bring civil actions and impose penalties. The Labor Commissioner has enforcement authority for whistleblower protections. The Board of Frontier Models and Government Operations Agency have regulatory and oversight responsibilities.

Monitor

• Entity Types: AI_Governance_Actor
• Summary: The Board of Frontier Models oversees regulatory updates and guidance. The Government Operations Agency issues regulations and guidance. The Attorney General receives compliance statements, audit reports, and incident reports. Third-party auditors conduct annual compliance audits.

AI Lifecycle Stages

Lifecycle stages covered by the documents, as defined in the OECD Framework for the Classification of AI Systems

• Plan and Design
• Build and Use Model
• Verify and Validate
• Deploy
• Operate and Monitor

AI Lifecycle Summary

The document comprehensively covers multiple AI lifecycle stages with primary focus on Build and Use Model, Verify and Validate, Deploy, and Operate and Monitor stages. It addresses planning through safety protocols, model development through compute thresholds, extensive testing and validation requirements, deployment restrictions, and ongoing monitoring obligations.

Technical Scope

Terms relating to technical scope that are mentioned or implicitly referenced in the document

• AI Models
• Frontier AI
• AI Systems
• Compute Threshold
• Generative AI

Technical Scope Summary

The document explicitly focuses on frontier AI models defined by compute thresholds (10^26 FLOPs for training, 3×10^25 FLOPs for fine-tuning). It addresses both AI models and AI systems, covers model derivatives and fine-tuning, and includes provisions for computing clusters. The document does not explicitly distinguish between general-purpose AI, task-specific AI, foundation models, generative AI, or predictive AI, but the compute thresholds and capabilities described suggest coverage of large-scale general-purpose models.