TikTok videos have been circulating that use manipulated audio to falsely depict anti-extremism protests as large-scale rallies in support of the AfD party. Fact-checkers confirmed that the footage was repurposed from 2024 protests, with AI-generated audio tracks added to create the illusion of pro-AfD chants. The accounts responsible for the content deleted the videos following inquiries, claiming no intent to spread misinformation.
TikTok videos purportedly depicted large crowds as chanting pro-AfD slogans by reportedly replacing the original audio with manipulated sound. The footage, originally from January 2024 anti-extremism protests, was repurposed in January 2025 to reportedly mislead viewers. Purported AI-generated or altered audio was added to create the illusion of far-right support. Fact-checkers confirmed the deception, and the accounts responsible later deleted the content, claiming no intent to spread misinformation.
Risk classification
- Primary risk domain: 4 Malicious actors
- Primary risk subdomain: 4.1 Disinformation, surveillance, and influence at scale
The incident involves the coordinated use of AI-manipulated audio to create political propaganda and influence public opinion ahead of Germany's federal elections.
Additional risk subdomains
- 3.1 False or misleading information: The AI-manipulated audio tracks fabricated false chants to mislead viewers about the nature of the protests.
Causal factors
- Entity: Human
- Intent: Intentional
- Timing: Post-deployment
The incident was caused by human actors intentionally using deployed AI audio generation tools to manipulate video soundtracks and spread political disinformation.
EU AI Act risk tier
- Risk tier: 3 Limited Risk
Risk Level 3: Limited Risk. The incident involves AI-generated content (manipulated audio/deepfakes) used to mislead, which falls under transparency obligations for deepfakes and synthetic media.
AI system and alleged parties
- AI system: unspecified
- AI purpose: Voice Generation; Social Media Content Generation
- Behaviour type: Tool
- Alleged developer: Unknown voice cloning technology developers
- Alleged deployer: TikTok user Alice Weidel Fan, TikTok user AfD John, AfD supporters
- Alleged harmed parties: Protesters against right-wing extremism in Germany, German election integrity, General public of Germany
Harm severity
Highest direct severity in any category: Severe. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
- Physical: direct Negligible, indirect Negligible
- Infrastructure: direct Negligible, indirect Negligible
- Property: direct Negligible, indirect Negligible
- Financial: direct Negligible, indirect Negligible
- Environmental: direct Negligible, indirect Negligible
- Malicious content: direct Minor, indirect Negligible
- Differential treatment: direct Negligible, indirect Negligible
- Civil rights: direct Negligible, indirect Negligible
- Democracy: direct Minor, indirect Negligible
- Privacy: direct Negligible, indirect Negligible
- Psychological: direct Negligible, indirect Negligible
- Epistemic: direct Severe, indirect Negligible
- Child sexual exploitation and abuse: direct Negligible, indirect Negligible
Malicious content
Reported: The report explicitly describes the creation and spread of AI-generated propaganda and manipulated audio tracks.
Directly caused: AI-generated audio tracks of a crowd chanting 'east, east, east' were created and overlaid onto real protest footage to fabricate pro-AfD rallies.
Indirectly caused: N/A
Inferred additional harm: It is likely that similar manipulated audio or video content was generated and shared across other social media platforms, exposing more users to political propaganda.
Democracy
Reported: The report explicitly describes concerns about fake news and AI-generated propaganda influencing Germany's federal elections.
Directly caused: The manipulated videos attempted to distort public perception of political support for the AfD party ahead of the elections.
Indirectly caused: N/A
Inferred additional harm: Such campaigns risk undermining trust in democratic processes and election integrity by fabricating false evidence of mass political support.
Epistemic
Reported: The report explicitly describes epistemic harm through the spread of fake news and AI-generated propaganda.
Directly caused: The TikTok videos used AI-generated audio to falsely depict anti-extremism protests as pro-AfD rallies, misleading millions of viewers.
Indirectly caused: N/A
Inferred additional harm: Widespread exposure to such deepfakes erodes public trust in video evidence and the shared information ecosystem.
People affected
- Occurrences reported: 1
- People reportedly exposed: 3000000
Potential causes
Management
- Inadequate Risk Mitigation: Platform management failed to secure elections against AI disinformation.
Technology
- AI Audio Manipulation Tools: AI tools allowed easy creation of realistic crowd chanting soundtracks.
- Algorithmic Amplification: TikTok algorithms promoted engagement, making fake news go viral quickly.
- Inadequate Automated Detection: Platform systems failed to flag AI-altered audio before videos went viral.
Data Inputs
- Manipulated Audio Overlays: Adding AI-generated chants to unrelated crowd footage misled viewers.
- Lack of Contextual Metadata: Missing metadata let old footage from other events be easily repurposed.
Human Factors
- Intentional Deception by Users: Accounts uploaded altered media to falsely suggest massive political support.
- User Susceptibility to Fakes: Viewers accepted and shared the videos without verifying their authenticity.
Process and Methods
- Weak Content Verification: TikTok lacked robust proactive verification processes for viral political media.
- Delayed Fact-Checking Response: External fact-checkers like Correctiv only identified fakes after viral reach.
Regulatory Environment
- Lack of Platform Accountability: Insufficient regulatory pressure on platforms to police AI-generated politics.
Information quality
- Classification confidence: High
- Reason for confidence: The reports from Euronews and Correctiv provide clear, verified details about the nature of the manipulation, the platforms used, the scale of views, and the specific political context in Germany. The role of AI in generating the audio tracks was confirmed by audio detectors, and the creators themselves admitted to the uploads before deleting them.
- Ambiguities identified: The specific AI tools used to generate or manipulate the audio tracks are not named.
- Alternative interpretations: None. The evidence clearly points to a coordinated political disinformation effort using manipulated media.
Ahead of Germany's federal elections, viral TikTok videos utilized AI-generated audio to falsely depict anti-extremism protests as massive rallies for the far-right AfD party. This incident represents a substantial information warfare and disinformation threat, leveraging synthetic media to manipulate public perception and influence democratic processes, though it lacked physical or economic impacts.
- Overall national security impact: Substantial
- Response level: Substantial
- Scope: Single nation
- Primary target: Germany
- Alleged perpetrator: Unknown
Threat characteristics
- Imminence: Near-term. The incident occurred in the lead-up to Germany's federal elections, indicating an active threat vector that requires monitoring during the election cycle.
- Autonomy: Human-controlled. The AI system functioned strictly as a content-generation tool under the direct control and intent of human operators.
- Novelty: Evolved capability. The incident represents an evolved application of deepfake technology, specifically using synthetic crowd chants to completely alter the political context of real video footage.
Impact by dimension
- Physical security: Negligible. No physical systems, critical infrastructure, or kinetic assets were targeted or affected by this incident.
- Information security: Substantial. AI-generated synthetic crowd audio was used to manipulate real protest footage, creating a viral disinformation campaign with over 3 million views ahead of national elections.
- Sovereignty: Minor. The campaign attempted to distort public perception of political support ahead of federal elections, representing a minor threat to democratic processes without disrupting actual government operations.
- Economic security: Negligible. The incident did not involve financial systems, strategic technologies, or critical economic supply chains.
- Societal stability: Minor. While the manipulation aimed to exacerbate political polarization and mislead the public, it did not result in civil unrest or systematic human rights violations.