Requires operators of AI companions to notify users that they are not communicating with a human at the start and every three hours during interactions. Imposes a $15,000 civil penalty per violation. Defines AI companion and operator terms.
Good coverage — Comprehensive governance measures or mitigations with clear procedures relating to the risk subdomain are explicitly described.
Minimal coverage — Brief mention but no specific mitigations, recommendations or governance measures relating to the risk subdomain are described.
All other risk subdomains had no coverage in this document.
Risk Coverage Summary
The document primarily addresses Human-Computer Interaction risks (5.1, 5.2) and Misinformation risks (3.1), with some coverage of malicious actor risks (4.3). The legislation focuses on preventing inappropriate relationships with AI companions and ensuring users are not misled about the non-human nature of their interactions. Coverage is concentrated in 4 subdomains with scores of 2-3.
Good coverage — Comprehensive governance measures or mitigations with clear procedures relating to the sector are explicitly described.
All other sectors had no coverage in this document.
Sectors Summary
The document primarily governs the Information sector, specifically operators of AI companion services that provide online interactive systems. This includes companies developing and deploying conversational AI applications designed to simulate human relationships through text, audio, or visual communication.
Hard Law
Legislative Status Summary
This is a binding state legislative act with mandatory obligations (using 'shall'), specific civil penalties of $15,000 per violation, and explicit court enforcement mechanisms through the Superior Court and municipal court.
Proposer
Target
Enforcer
Monitor
Lifecycle stages covered by the documents, as defined in the OECD Framework for the Classification of AI Systems
AI Lifecycle Summary
The document primarily governs the Deploy and Operate and Monitor stages of the AI lifecycle, focusing on requirements that apply when AI companion systems are made available to users and during their ongoing operation. It does not address earlier stages like planning, data collection, model building, or validation.
Terms relating to technical scope that are mentioned or implicitly referenced in the document
Technical Scope Summary
The document explicitly mentions and defines AI systems (as 'AI companion'), generative artificial intelligence, and has detailed definitions of these concepts. It does not mention frontier AI, general purpose AI, foundation models, compute thresholds, or open-weight models. The focus is on a specific application category (AI companions) using generative AI technology.
Document data from AGORA, CSET Emerging Technology Observatory.