Voices Created Using Publicly Available App Stolen and Resold as NFT without Attribution

An AI-synthetic audio sold as an NFT on Voiceverse’s platform was acknowledged by the company for having been created by 15.ai, a free web app specializing in text-to-speech and AI-voice generation, and reused without proper attribution.

Risk classification

• Primary risk domain: 6 Socioeconomic & Environmental
• Primary risk subdomain: 6.3 Economic and cultural devaluation of human effort

The incident involves the unauthorized commercial exploitation of a creator's free AI voice synthesis work, leading to the devaluation of their creative effort and distress over the field being misrepresented.

Additional risk subdomains

• 4.3 Fraud, scams, and targeted manipulation: The commercial entity used another's AI-generated output without attribution to promote their own NFT platform for profit, representing an unfair exploitation for personal advantage.

Causal factors

• Entity: Human
• Intent: Unintentional
• Timing: Post-deployment

The risk and subsequent public backlash were caused by the human decision of Voiceverse's marketing team to use 15.ai's output without credit, which was an unexpected outcome of pursuing their marketing goal.

EU AI Act risk tier

• Risk tier: 4 Minimal or No Risk

Minimal or No Risk: The AI system 15.ai is used for entertainment and creative text-to-speech generation, which poses low or negligible risks to users and society.

AI system and alleged parties

• AI system: 15.ai
• AI purpose: Voice Generation; Text Style Replication
• Behaviour type: Tool
• Alleged developer: 15.ai
• Alleged deployer: 15.ai
• Alleged harmed parties: 15.ai users, 15.ai

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Negligible, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Minor, indirect Negligible
• Epistemic: direct Negligible, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Psychological

Reported: Yes, the report explicitly describes psychological distress experienced by the creator of 15.ai.

Directly caused: The creator of 15.ai stated they were 'extremely depressed' because their work was stolen, used for profit, and the field of vocal synthesis was misrepresented.

People affected

• Occurrences reported: 1
• People reportedly harmed: 1
• People reportedly exposed: 1

Potential causes

Management

• Lack of Oversight on Marketing: Management had no knowledge of or oversight over assets used by marketing.
• Growth at All Costs Mindset: Rushing NFT products to market without auditing safety or legal compliance.

Technology

• Ease of Voice Replication: AI vocal synthesis technology allows easy replication and modification of voices.
• Lack of Provenance Tracking: No technical mechanisms existed to track the source of the generated audio.

Data Inputs

• Unauthorized Audio Extraction: Audio was taken from 15.ai platform without authorization or proper licensing.
• Alteration of Audio Data: The voice was pitched up to sound different and hide its original source.

Human Factors

• Disregard of Terms of Service: Marketing team ignored 15.ai's requirement for attribution and non-mixing.
• Prioritizing Profit over Ethics: Using free, non-commercial AI voices to generate commercial NFT assets.

Process and Methods

• Inadequate Asset Review: Lack of verification processes to check origin of assets used in marketing.
• Poor Content Sourcing Protocols: No formal procedure for checking intellectual property rights of AI assets.

Regulatory Environment

• Lack of AI IP Protection: Weak regulatory frameworks governing ownership of AI-generated voices.

Information quality

• Classification confidence: High
• Reason for confidence: The reports provide clear, uncontradicted details about the attribution theft, the parties involved, and the creator's response, allowing for a highly confident assessment.

The incident involves a minor intellectual property and attribution dispute where an NFT platform used an AI-generated voice without proper credit. This is a localized commercial and ethical issue with negligible national security implications.

• Overall national security impact: Negligible
• Scope: Unknown
• Primary target: No clear primary
• Alleged perpetrator: Voiceverse

Threat characteristics

• Imminence: Long-term. No active national security crisis or threat; the incident is fully resolved.
• Autonomy: Human-controlled. The AI system (15.ai) acted as a passive text-to-speech tool controlled entirely by human users.
• Novelty: Established threat. Unattributed use of digital content and minor intellectual property disputes are common and established issues.

Impact by dimension

• Physical security: Negligible. No impact on physical systems, infrastructure, or human safety.
• Information security: Negligible. The incident involves a minor intellectual property dispute over commercial marketing materials, with no intelligence or national-level information warfare implications.
• Sovereignty: Negligible. No impact on state authority, government decision-making, or sovereign functions.
• Economic security: Negligible. Limited to a localized copyright and attribution dispute between a commercial NFT platform and an independent creator, with no strategic economic or technological impact.
• Societal stability: Negligible. No threat to societal stability, civil liberties, or population safety. The harm was restricted to psychological distress of a single independent creator.