High Schoolers Posted Deepfaked Video Featuring Principal Making Violent Racist Threats

Three Carmel High School students posted on TikTok a video featuring a nearby middle school's principal making aggressive racist remarks and violent threats against Black students.

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The incident involved the targeted creation of deepfake videos to impersonate and humiliate specific individuals (the principal and deputy) while directing racist threats at Black students.

Additional risk subdomains

• 1.2 Exposure to toxic content: The deepfake videos exposed the school community to highly toxic content, including explicit hate speech, racial slurs, and threats of gun violence.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The incident was caused by human actors intentionally utilizing deployed AI deepfake generation tools to create harmful impersonation videos.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The report describes the creation and dissemination of deepfakes, which are subject to transparency obligations under the EU AI Act to ensure users are aware the content is synthetic.

AI system and alleged parties

• AI system: unspecified
• AI purpose: Deepfake Video Generation; Voice Generation
• Behaviour type: Tool
• Alleged developer: unknown
• Alleged deployer: unnamed high school students
• Alleged harmed parties: John Piscitella

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Minor, indirect Minor
• Differential treatment: direct Minor, indirect Minor
• Civil rights: direct Minor, indirect Minor
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Minor, indirect Minor
• Epistemic: direct Minor, indirect Minor
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Malicious content

Reported: The report explicitly describes toxic and malicious content created and spread directly by the incident.

Directly caused: The students directly created and posted two deepfake videos on TikTok containing virulently racist slurs and explicit threats of school shootings and KKK-style violence.

Indirectly caused: The dissemination of these videos sparked widespread community outrage, public condemnation, and heated school board meetings.

Inferred additional harm: The videos may have been downloaded, re-shared, or archived by other users on TikTok or other social media platforms, extending their reach beyond the initial deletion.

Differential treatment

Reported: The report explicitly describes differential treatment of Black students who were targeted by the racist deepfakes.

Directly caused: The deepfake content directly singled out Black students for racial harassment, slurs, and threats of violence, creating a hostile educational environment.

Indirectly caused: The incident highlighted and exacerbated existing systemic racial inequalities and historical patterns of bullying against Black students in the school district.

Inferred additional harm: The failure of the school to immediately notify parents or provide extra security may have disproportionately impacted the sense of safety and equal treatment of Black families in the community.

Civil rights

Reported: The report explicitly describes violations of civil rights through severe racial harassment and threats of violence targeting a protected group.

Directly caused: The deepfakes violated the civil rights of Black students to be free from racial harassment and threats of violence in an educational institution.

Indirectly caused: The incident led to a perceived failure by school authorities and law enforcement to protect the civil rights and safety of the targeted students.

Inferred additional harm: The lack of federal legislation protecting individuals from non-consensual deepfake impersonation represents a broader systemic gap in protecting civil rights in the digital age.

Psychological

Reported: The report explicitly describes psychological harm, including fear, anger, and distress experienced by parents and students over the violent threats and lack of communication.

Directly caused: The deepfake videos caused direct psychological distress, fear, and anxiety to the impersonated principal and deputy, as well as the Black students who were the targets of the violent threats.

Indirectly caused: Dozens of parents experienced severe anxiety, anger, and fear for their children's safety due to the school's failure to communicate the nature of the active shooting threats.

Inferred additional harm: It is likely that many Black students in the district suffered ongoing trauma, feelings of unsafety, and racial distress that were not fully detailed in the reports.

Epistemic

Reported: The report explicitly describes epistemic harm through the creation of highly realistic deepfake videos that fabricated false statements.

Directly caused: The deepfake videos fabricated false evidence, misleading viewers into believing that the middle school principal and a sheriff's deputy had made violent, racist remarks.

Indirectly caused: The realistic nature of the deepfakes caused confusion among parents, some of whom did not realize the videos were fake before they were deleted, eroding trust in school leadership.

Inferred additional harm: The incident contributes to a broader erosion of trust in digital media and public officials, as synthetic media makes it increasingly difficult to verify real statements.

People affected

• Occurrences reported: 1
• People reportedly harmed: 100
• People reportedly exposed: 1000

Potential causes

Management

• Inadequate Risk Assessment: School administration failed to anticipate or prepare for AI-enabled threats.
• Poor Communication Strategy: Management was vague and slow in addressing parents' safety concerns.

Technology

• Advanced AI Deepfake Tech: Highly advanced AI enabled realistic voice cloning and face synthesis.
• High Accessibility of AI Tools: Easy access to deepfake tools allowed students to generate harmful content.

Data Inputs

• Use of Principal's Likeness: Audio/visual data of school staff was used without consent to train AI.
• Lack of Audio/Video Verification: No digital signatures existed to verify the authenticity of the video.

Human Factors

• Student Misuse of AI: High school students deliberately used AI to target and harass school staff.
• Racial Bias and Hatred: Pre-existing racist attitudes in the community motivated the deepfakes.

Process and Methods

• Delayed School Notification: School failed to immediately notify parents about the threatening videos.
• Lack of Reporting Systems: Absence of anonymous reporting systems delayed detection of the videos.

Regulatory Environment

• Lack of Deepfake Legislation: No federal laws protect individuals from non-consensual deepfakes.
• Gaps in Criminal Law: Sheriff's office determined that creating the deepfakes broke no laws.

Information quality

• Classification confidence: High
• Reason for confidence: The reports from Vice News and PetaPixel provide consistent, detailed accounts of the incident, including specific quotes from the deepfake videos, the reactions of parents and school board officials, and the legal/investigative outcomes. The role of AI (deepfake technology) is explicitly stated, and the resulting harms are well-documented.
• Ambiguities identified: The specific AI tools or platforms used by the students to generate the deepfakes are not identified in the reports.
• Alternative interpretations: None. The facts of the deepfake creation, the content of the videos, and the community response are clear and uncontested.

High school students used consumer AI tools to create racist and threatening deepfakes of a principal and deputy. While causing localized community distress and highlighting legislative gaps regarding synthetic media harassment, the incident has negligible direct national security implications.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: United States
• Alleged perpetrator: High school students

Threat characteristics

• Imminence: Long-term. The immediate incident is resolved, but it highlights an ongoing long-term regulatory and societal challenge regarding deepfake harassment.
• Autonomy: Human-controlled. The AI tools were directly operated by human users to generate specific synthetic media outputs.
• Novelty: Evolved capability. Demonstrates the growing accessibility of highly realistic voice and video cloning technologies to non-technical adolescent actors.

Impact by dimension

• Physical security: Negligible. No physical systems, critical infrastructure, or military assets were compromised or targeted in this localized incident.
• Information security: Negligible. The deepfakes were created by local students rather than a foreign state actor or sophisticated influence campaign, posing no threat to national intelligence.
• Sovereignty: Negligible. No core government functions, national electoral systems, or state sovereignty operations were disrupted by this local school incident.
• Economic security: Negligible. The incident did not target strategic industries, financial systems, or national technological advantages.
• Societal stability: Minor. The incident caused localized racial tension, distress among Black students, and community anger, but did not threaten large-scale national social cohesion.