Purported Deepfake TikTok Account Using Grainville School Branding in Jersey Reportedly Targeted Staff, Prompting Police Probe

A TikTok account allegedly using the badge and branding of Grainville School in Jersey (Channel Islands) reportedly uploaded five "deeply inappropriate," purportedly AI-generated deepfake videos, including material featuring staff. The Education and Lifelong Learning Minister said the incident was reported to TikTok and the States of Jersey Police and urged the public not to view or share the content. The account was reportedly later removed.

Risk classification

• Primary risk domain: 4 Malicious actors
• Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation

The incident involved the creation of deeply inappropriate deepfake videos targeting and impersonating specific school staff members, which represents targeted humiliation of specific victims.

Additional risk subdomains

• 1.2 Exposure to toxic content: The deeply inappropriate deepfake videos were uploaded to TikTok, exposing the public and school community to harmful and inappropriate synthetic content.

Causal factors

• Entity: Human
• Intent: Intentional
• Timing: Post-deployment

The incident was caused by a human actor who intentionally used a deployed AI deepfake generation tool to target and impersonate school staff.

EU AI Act risk tier

• Risk tier: 3 Limited Risk

Limited Risk: The report describes the creation of 'deepfakes', which are explicitly categorized as posing a moderate risk requiring transparency obligations under the EU AI Act.

AI system and alleged parties

• AI system: None named
• AI purpose: Deepfake Video Generation; Social Media Content Generation
• Behaviour type: Tool
• Alleged developer: Unknown voice cloning technology developers, Unknown deepfake technology developers
• Alleged deployer: Unknown TikTok users, Unknown malicious actors
• Alleged harmed parties: Teachers, Grainville School (Jersey) staff, Grainville School (Jersey), Epistemic integrity

Harm severity

Severity ratings are based on this scale.

Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.

• Physical: direct Negligible, indirect Negligible
• Infrastructure: direct Negligible, indirect Negligible
• Property: direct Negligible, indirect Negligible
• Financial: direct Negligible, indirect Negligible
• Environmental: direct Negligible, indirect Negligible
• Malicious content: direct Minor, indirect Negligible
• Differential treatment: direct Negligible, indirect Negligible
• Civil rights: direct Negligible, indirect Negligible
• Democracy: direct Negligible, indirect Negligible
• Privacy: direct Negligible, indirect Negligible
• Psychological: direct Negligible, indirect Negligible
• Epistemic: direct Minor, indirect Negligible
• Child sexual exploitation and abuse: direct Negligible, indirect Negligible

Malicious content

Reported: The report explicitly describes 'deeply inappropriate deepfake content' uploaded to TikTok.

Directly caused: Five AI-generated deepfake videos featuring school staff and using the school's branding were uploaded to TikTok.

Epistemic

Reported: The report explicitly describes the creation of deepfakes to impersonate school staff and the school's branding.

Directly caused: Five deepfake videos were created to look real, impersonating school staff and using Grainville School's badge and branding.

People affected

• Occurrences reported: 1
• People reportedly harmed: 5
• People reportedly exposed: 100

Potential causes

Management

• Inadequate Proactive Monitoring: School and authorities monitored reactively after the videos appeared.

Technology

• AI Deepfake Generation: AI tools allowed creation of realistic fake videos of school staff.
• Platform Hosting Capabilities: TikTok hosted and distributed deepfakes targeting school staff.

Data Inputs

• School Badge and Branding: School branding was used in videos to falsely imply official source.
• Staff Likeness Data: Staff images or audio were used to generate deepfake videos.

Human Factors

• Malicious Creator Action: An individual chose to target school staff with harmful deepfakes.
• Public Engagement with Material: People watching and sharing the deepfakes increased their reach.

Process and Methods

• Reactive Content Removal: Platform relied on reports to remove content rather than proactive blocks.

Regulatory Environment

• Weak Impersonation Laws: Lack of preventive legal barriers against AI-based impersonation.

Information quality

• Classification confidence: High
• Reason for confidence: The report clearly details the incident where a TikTok account posted deepfakes of school staff using the school's branding. The facts are straightforward, and the application of the boundary rules makes the classification highly confident.
• Ambiguities identified: The specific AI tool used to generate the deepfakes is not identified, and the exact nature of the 'deeply inappropriate' content is not detailed.
• Alternative interpretations: The incident could be interpreted as a privacy violation, but boundary rule B1 clarifies that using public likeness for targeted humiliation is classified under 4.3 rather than 2.1.

An unauthorized social media account used AI deepfakes to impersonate Jersey school staff and school branding. While causing local distress and requiring police and platform intervention, the incident represents a localized harassment case with negligible national security implications.

• Overall national security impact: Minor
• Scope: Single nation
• Primary target: United Kingdom
• Alleged perpetrator: Unknown

Threat characteristics

• Imminence: Long-term. The active threat has been resolved with the removal of the TikTok account, though the general capability of generating deepfakes remains an ongoing concern.
• Autonomy: Human-controlled. The AI system functioned as a tool directly controlled by a human creator to generate specific synthetic media.
• Novelty: Established threat. The use of AI deepfakes to impersonate and harass individuals on social media is an established and recurring threat.

Impact by dimension

• Physical security: Negligible. No physical infrastructure, kinetic weapons, or human safety systems were affected or targeted in this incident.
• Information security: Negligible. While deepfakes were used, they targeted local school staff and did not constitute a state-sponsored information warfare campaign or compromise intelligence security.
• Sovereignty: Negligible. There was no disruption to core government decision-making, electoral systems, or state sovereignty.
• Economic security: Negligible. The incident had no impact on strategic industries, technological competitive advantage, or financial systems.
• Societal stability: Minor. The deepfakes targeted and harassed specific school staff, causing localized distress, but did not threaten large-scale societal stability or civil liberties.