Spokane-Area Fred's Appliance and Victory Media Allegedly Used AI-Assisted Voice Editing Without Spokeswoman's Consent

Spokane-area appliance retailer Fred's Appliance and production company Victory Media allegedly used AI-assisted editing to alter the voice of Amber George, the longtime spokeswoman for Fred's Appliance, in advertisements assembled from earlier footage. George said the ads were created without her knowledge or consent. The companies acknowledged the voice edits but said they believed her contract authorized them and denied using AI to alter her image.

Risk classification

• Primary risk domain: 6 Socioeconomic & Environmental
• Primary risk subdomain: 6.3 Economic and cultural devaluation of human effort

The incident involves the unauthorized reproduction of a spokesperson's voice using AI, which she argues diminishes her value as a performer and exploits her creative assets without compensation.

Additional risk subdomains

• 4.3 Fraud, scams, and targeted manipulation: The production company cloned the spokesperson's voice to create a commercial advertisement without her consent, effectively impersonating her for commercial benefit.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The risk and subsequent harm were caused by the intentional decision of humans at Victory Media and Fred's Appliance to clone the spokesperson's voice without her explicit consent.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Risk Level 3: Limited Risk. The report describes the use of AI-assisted voice editing to clone a spokesperson's voice, which constitutes AI-generated content or a deepfake, falling under the transparency obligations of Limited Risk systems.

AI system and alleged parties

• AI system: AI-assisted voice editing
• AI purpose: Voice Generation; Voice Generation
• Behaviour type: Tool
• Alleged developer: Voice cloning technology developers, Synthetic video generation technology developers, Synthetic media generation technology developers, Synthetic audio generation technology developers, Deepfake technology developers
• Alleged deployer: Victory Media, Media production companies, Fred's Appliance, Deepfake creators, Advertisers
• Alleged harmed parties: Spokespeople, Privacy, Amber George

Harm severity

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Minor, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Financial

Reported: The report describes financial impacts related to the loss of employment and spokesperson value, though specific monetary figures are not quantified.

Directly caused: George lost her ongoing spokesperson role and associated income after ending her relationship with Fred's Appliance due to the unauthorized AI use.

Indirectly caused: N/A

Inferred additional harm: George may suffer long-term financial harm due to the devaluation of her professional voice and likeness as a spokesperson, though the exact monetary value is not specified in the report.

People affected

• Occurrences reported: 1
• People reportedly harmed: 1
• People reportedly exposed: 1

Potential causes

Management

• Inadequate Risk Assessment: Management failed to assess legal risks of using AI voice cloning.
• Prioritizing Efficiency Over Consent: Used AI to quickly update pricing in ads without checking performer rights.

Technology

• AI Voice Cloning Technology: Used AI-assisted voice editing to mimic spokesperson's voice without consent.
• Repurposing of Old Footage: Used past footage and audio to construct new promotional materials.

Data Inputs

• Unauthorized Use of Historical Audio: Past commercial recordings were used to train or feed the voice clone.

Human Factors

• Misinterpretation of Agreement: Production company assumed existing contracts permitted AI voice modification.
• Overplaced Trust in Business Partners: Spokesperson trusted the company, delaying early boundary setting.

Process and Methods

• Lack of Consent Verification: No formal process to get explicit consent before using AI voice cloning.
• Absence of AI Transparency Policies: No policy to notify performers when AI is used to replicate their likeness.

Regulatory Environment

• Ambiguous Legal Frameworks: Lack of clear regulations governing AI voice cloning and likeness rights.

Information quality

• Classification confidence: High
• Reason for confidence: The report provides clear, detailed accounts from both the affected spokesperson and the companies involved, including specific details about the lawsuit, the contract dispute, and the nature of the AI technology used.
• Ambiguities identified: There is a dispute between the parties regarding whether the existing contract authorized the use of AI-assisted voice editing.
• Alternative interpretations: The incident could be viewed strictly as a contract dispute rather than an AI safety failure, though the core issue revolves around the unauthorized deployment of voice-cloning technology.

A localized civil dispute in the United States involving the unauthorized use of AI voice-cloning technology for a local retail advertisement. The incident represents a standard commercial and contractual disagreement with negligible national security implications across all assessed categories.

• Overall national security impact: Negligible
• Response level: Minor
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: Victory Media and Fred's Appliance

Threat characteristics

• Imminence: Long-term. This is a civil legal dispute with no immediate or near-term national security implications.
• Autonomy: Human-controlled. The AI voice-cloning technology was directly operated as a tool by humans at a production company to edit existing advertisements.
• Novelty: Established threat. Unauthorized voice cloning and deepfake audio generation are established issues with numerous prior occurrences and legal precedents.

Impact by dimension

• Physical security: Negligible. The incident is a localized commercial dispute and poses no threat to physical systems, critical infrastructure, or human safety.
• Information security: Negligible. No state-sponsored disinformation, intelligence compromise, or national-level information warfare operations are associated with this incident.
• Sovereignty: Negligible. The incident involves a dispute between private commercial entities and has no impact on state authority, electoral systems, or government functions.
• Economic security: Negligible. While there is a localized financial dispute for the individual, there is no threat to national financial systems, strategic industries, or technological competitive advantage.
• Societal stability: Negligible. The incident represents an isolated civil dispute over publicity and property rights, with no broader implications for societal stability, mass surveillance, or systemic human rights violations.