Hack Club founder PERSON_001 was targeted by a sophisticated AI-driven phishing attack where scammers impersonated Google support staff. The attackers used AI voice cloning to sound like real engineers and exploited Google's own infrastructure, including the Google Assistant calling system and the g.co subdomain, to gain the victim's trust. The victim narrowly avoided account compromise by identifying inconsistencies in the scammers' story. Google has since suspended the account used in the scam and is working to harden its defenses against such abuse.
Hack Club founder Zach Latta was reportedly targeted in an AI-assisted phishing attack exploiting Google’s own systems. Cybercriminals allegedly spoofed a legitimate Google Assistant number and used voice cloning to impersonate support staff, claiming unusual login activity from Frankfurt. They reinforced the deception by sending a real email from Google’s Workspace domain. The attack, which relied on Google’s g.co subdomain, was thwarted when inconsistencies raised Latta’s suspicions.
Risk classification
- Primary risk domain: 4 Malicious actors
- Primary risk subdomain: 4.3 Fraud, scams, and targeted manipulation
The scammers used AI-powered voice cloning to impersonate Google support staff in a highly targeted attempt to defraud specific victims and steal their account credentials.
Additional risk subdomains
- 2.2 AI system security vulnerabilities and attacks: The attackers exploited vulnerabilities in Google's infrastructure, including spoofing Google Assistant caller ID and abusing the g.co subdomain registration process.
Causal factors
- Entity: Human
- Intent: Intentional
- Timing: Post-deployment
The incident was initiated by human cybercriminals who intentionally used AI voice generation and infrastructure exploits to conduct a phishing scam.
EU AI Act risk tier
- Risk tier: 3 Limited Risk
Limited Risk: The incident involves AI-generated content such as deepfakes, specifically AI-powered phone calls mimicking human voices to deceive users.
AI system and alleged parties
- AI system: unspecified AI voice cloning
- AI purpose: Voice Generation; AI Voice Assistant
- Behaviour type: Assistant
- Alleged developer: Unknown voice cloning technology
- Alleged deployer: Voice phishers, Unknown scammers, Scammers impersonating Google staff
- Alleged harmed parties: Zach Latta, Google users
Harm severity
Severity ratings are based on this scale.
Highest direct severity in any category: Negligible. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
- Physical: direct Negligible, indirect Negligible
- Infrastructure: direct Negligible, indirect Negligible
- Property: direct Negligible, indirect Negligible
- Financial: direct Negligible, indirect Minor
- Environmental: direct Negligible, indirect Negligible
- Malicious content: direct Negligible, indirect Negligible
- Differential treatment: direct Negligible, indirect Negligible
- Civil rights: direct Negligible, indirect Negligible
- Democracy: direct Negligible, indirect Negligible
- Privacy: direct Negligible, indirect Minor
- Psychological: direct Negligible, indirect Negligible
- Epistemic: direct Negligible, indirect Negligible
- Child sexual exploitation and abuse: direct Negligible, indirect Negligible
Financial
Reported: The report describes one related incident where a Google account takeover led to a half-million-dollar crypto raid.
Indirectly caused: An indirect incident mentioned in the reports resulted in a financial loss of $500,000 due to a crypto raid following a similar account takeover.
Inferred additional harm: It is highly likely that other unmentioned victims suffered financial losses from similar sophisticated AI-driven phishing scams.
Privacy
Reported: The reports describe attempts to compromise user accounts and steal credentials, which constitutes a severe privacy risk.
Directly caused: The scammers attempted to obtain the Gmail credentials and 2FA codes of PERSON_001 and Sam Mitrovic, which would have granted unauthorized access to their private data.
Indirectly caused: One victim, Griffin, had his account compromised, leading to unauthorized access to his personal data and financial accounts.
Inferred additional harm: It is likely that other users had their accounts successfully compromised, resulting in unauthorized access to sensitive personal emails, contacts, and documents.
People affected
- Occurrences reported: 3
- People reportedly harmed: 1
- People reportedly exposed: 4
Potential causes
Management
- Delayed Defense Hardening: Google only hardened defenses after the sophisticated scam was reported.
- Poor Abuse Risk Assessment: Management overlooked the risk of g.co subdomain abuse for phishing.
Technology
- Realistic AI Voice Generation: AI-powered voices mimicking humans made the phishing call highly realistic.
- Caller ID Spoofing: Attackers spoofed Google Assistant number to display a Google caller ID.
- Abuse of g.co Subdomain: Attackers used g.co subdomain to send authentic-looking emails.
Data Inputs
- Unverified Sign-up Data: Google allowed g.co references at sign-up without domain verification.
- Genuine 2FA Code Injection: Scammers triggered real 2FA codes to build trust during the call.
Human Factors
- Reliance on Traditional Rules: Victims trusted verified phone numbers and domains to confirm legitimacy.
- Cognitive Overload: Conflicting information and real 2FA codes confused the victim.
Process and Methods
- Lack of Domain Verification: No process existed to verify ownership of g.co subdomains at sign-up.
- Inadequate Voice Authentication: No mechanism was in place to verify if support calls were from humans.
Information quality
- Classification confidence: High
- Reason for confidence: The reports provide consistent, detailed accounts of the phishing methodology, including specific technical exploits like the g.co subdomain abuse and Google Assistant caller ID spoofing. Multiple independent sources and victims confirm the pattern of the attack, leaving little ambiguity about the nature of the threat.
- Ambiguities identified: The exact AI voice generation software used by the scammers is not specified, and the precise relationship between the Google Assistant number and the scammers' calling mechanism is slightly unclear.
- Alternative interpretations: The incident could be viewed purely as a traditional social engineering scam, but the integration of highly realistic AI voice cloning and infrastructure exploits makes it a distinct AI-enabled threat.
Cybercriminals leveraged sophisticated AI voice cloning and Google infrastructure exploits to conduct highly convincing phishing scams against Gmail users. While resulting in individual financial losses, the incident represents an evolved cybercrime capability rather than a direct threat to national security, highlighting the growing challenge of AI-enabled social engineering.
- Overall national security impact: Minor
- Scope: Single nation
- Primary target: United States
- Alleged perpetrator: Unknown
Threat characteristics
- Imminence: Long-term. Represents an ongoing cyber capability and tactical concern rather than an active, imminent national security crisis.
- Autonomy: Human-controlled. The AI voice cloning and calling tools were directly controlled and deployed by human scammers to execute the phishing scheme.
- Novelty: Evolved capability. Represents an evolution of traditional social engineering attacks by integrating highly realistic AI-generated voice cloning with technical infrastructure exploits.
Impact by dimension
- Physical security: Negligible. No physical systems, critical infrastructure, or human safety were threatened or impacted by this credential harvesting and phishing attempt.
- Information security: Minor. While leveraging advanced AI voice cloning and infrastructure exploits, the incident represents a targeted cybercrime attempt rather than state-sponsored information warfare or intelligence compromise.
- Sovereignty: Negligible. The incident targeted private individuals and did not impact government decision-making, elections, or state sovereignty.
- Economic security: Minor. The incident resulted in a financial loss of $500,000 for one victim, but it does not pose a systemic threat to national financial stability, strategic industries, or technological competitiveness.
- Societal stability: Minor. The attack targeted individual account credentials and privacy, but did not cause large-scale societal instability, systematic discrimination, or mass surveillance.