AI Firm Lovo Accused of Illegally Replicating Voice Actors' Voices

Two voice actors, Paul Skye Lehrman and Linnea Sage, are suing AI start-up Lovo for allegedly creating and promoting unauthorized clones of their voices. Lovo's synthetic voices were discovered in various media, including a podcast and promotional videos. The actors claim they were misled into providing voice samples, which were then used without consent, violating trademark and privacy laws.

Risk classification

• Primary risk domain: 6 Socioeconomic & Environmental
• Primary risk subdomain: 6.3 Economic and cultural devaluation of human effort

Lovo used the plaintiffs' voice recordings to create synthetic clones that directly compete with their professional livelihoods, devaluing their human effort and threatening their careers.

Additional risk subdomains

• 4.3 Fraud, scams, and targeted manipulation: Lovo employees used deceptive pretenses and false promises of 'internal use only' to obtain the voice recordings used to build the commercial clones.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The harm was caused by the intentional actions of Lovo employees who deceptively obtained voice recordings to create and commercialize unauthorized voice clones.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The system is used to generate synthetic audio and voice clones, which falls under the category of AI-generated content such as deepfakes, requiring transparency obligations.

AI system and alleged parties

• AI system: Lovo voice-cloning system (Lovo)
• AI purpose: Voice Generation
• Behaviour type: Tool
• Alleged developer: Lovo
• Alleged deployer: Lovo
• Alleged harmed parties: Voice Actors, Paul Skye Lehrman, Linnea Sage

Harm severity

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Minor, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Privacy

Reported: Yes, the report notes that the lawsuit accuses Lovo of violating several state privacy laws by promoting clones of their voices.

Directly caused: Lovo used the plaintiffs' personal voice recordings, obtained under false pretenses, to create commercial voice clones without their consent.

Indirectly caused: N/A

Inferred additional harm: Other individuals may have had their voice data ingested and cloned without explicit consent, violating their personal data privacy.

People affected

• Occurrences reported: 1
• People reportedly harmed: 2
• People reportedly exposed: 2

Potential causes

Management

• Growth Over Ethical Sourcing: Lovo prioritized rapid scaling and investor pitches over actor consent.
• Poor Risk Management: Failure to assess legal risks of using voice clones without explicit consent.

Technology

• Realistic Voice Synthesis: Allowed creation of highly accurate clones indistinguishable from real actors.
• Irreversible Software Downloads: Distributed cloned voice software cannot be easily recalled from customers.

Data Inputs

• Deceptive Voice Sourcing: Voice samples acquired under false pretenses of internal or academic use.
• Unverified Training Datasets: Training on public databases without verifying individual speaker consent.

Human Factors

• Trust in Freelance Platforms: Actors trusted anonymous clients on Fiverr without verifying their identity.

Process and Methods

• No Consent Verification: Lovo lacked processes to verify if actors consented to commercial cloning.
• Inadequate Cease and Desist Action: Removing clones from site failed to stop use of already downloaded software.

Regulatory Environment

• Vague AI Voice Regulations: Lack of clear federal laws governing voice ownership and AI synthesis rights.

Information quality

• Classification confidence: High
• Reason for confidence: The report from the New York Times is highly detailed, providing specific names, dates, monetary figures, and quotes from both the plaintiffs and legal representatives. The facts regarding the unauthorized voice cloning and subsequent lawsuit are clearly laid out.
• Ambiguities identified: It is not fully clear whether Lovo directly used the plaintiffs' recordings to train their base model or if they only used them to generate the specific clones.
• Alternative interpretations: Lovo argues that if consent was given for the initial recordings, there is no violation, suggesting a contractual dispute rather than outright theft.

A civil class-action lawsuit against AI startup Lovo for unauthorized voice cloning highlights growing concerns over intellectual property and data ethics. Because the incident is confined to commercial and civil legal disputes regarding voice actors' livelihoods, it carries negligible national security implications across all assessed categories.

• Overall national security impact: Negligible
• Response level: Minor
• Scope: Single nation
• Primary target: No clear primary
• Alleged perpetrator: Lovo

Threat characteristics

• Imminence: Long-term. This is a civil legal dispute and commercial practice issue, presenting no immediate or near-term national security crisis.
• Autonomy: Human-controlled. The AI voice synthesis tool is operated and deployed by human users who control the input text and the distribution of the generated audio.
• Novelty: Evolved capability. While voice cloning is an established technology, the commercial scale and deceptive procurement of training data represent an evolved legal and ethical challenge.

Impact by dimension

• Physical security: Negligible. The incident involves a commercial voice-cloning dispute and does not impact physical systems, critical infrastructure, or human safety.
• Information security: Negligible. While a cloned voice was used in a YouTube video about the Ukraine war, there is no evidence of a coordinated state-sponsored disinformation campaign or compromise of intelligence capabilities.
• Sovereignty: Negligible. The incident is a civil trademark and privacy lawsuit between individuals and a startup, with no disruption to state authority or government operations.
• Economic security: Negligible. The economic impact is limited to individual voice actors' livelihoods and does not threaten national financial systems, strategic industries, or technological advantages.
• Societal stability: Negligible. The incident concerns localized privacy and copyright issues for specific individuals, presenting no large-scale threat to social cohesion or civil liberties.