.avif){kind=small}
In 2023, Australian consumers lost over $8 million to investment scams that utilized AI-generated deepfake videos and fake news articles to impersonate celebrities. The National Anti-Scam Centre received over 400 reports of these incidents, which involved fraudulent trading platforms such as Quantum AI and Immediate Edge. Victims were lured into providing personal details or investing cryptocurrency, often resulting in total financial loss or persistent harassment.
In 2023, Australians reportedly lost over $8 million to scams involving purported deepfake videos and fake news articles that falsely endorsed investment trading platforms. Scammers reportedly used AI-generated content featuring celebrities to mislead victims, leading to significant financial losses. The National Anti-Scam Centre received over 400 reports of these incidents. One man is reported to have lost over $80,000 in cryptocurrency.
The incident involves scammers using AI-generated deepfakes and fake news articles to impersonate trusted public figures for illegitimate financial benefit.
The harm was caused by human scammers intentionally deploying AI-generated deepfakes and fake articles to defraud victims.
Limited Risk: The incident involves 'AI-generated content such as deepfakes', which falls under Risk Level 3 due to transparency obligations requiring users to be informed they are interacting with AI-generated media.
Severity ratings are based on this scale.
Highest direct severity in any category: Minor. Severity is scored from Negligible to Catastrophic in each harm category, for harm the reports describe as caused directly or indirectly by the AI system.
Reported: The report describes over 400 incidents causing a total financial loss of over $8,000,000 in 2023, with an average loss of approximately $20,000 per reported occurrence.
Indirectly caused: An Australian man lost $80,000 in cryptocurrency, and overall Australian consumers lost over $8,000,000 to these scams, averaging $20,000 per reported occurrence.
Inferred additional harm: Since many scams go unreported, the actual financial losses are likely significantly higher than the reported $8,000,000.
Reported: The report explicitly describes malicious content in the form of deepfake videos and fake news articles used to deceive consumers.
Directly caused: AI-generated deepfake videos (such as a fake interview of Elon Musk) and fake news articles featuring celebrities were directly created and spread on social media and reputable news sites.
Inferred additional harm: It is likely that thousands of social media users were exposed to these malicious deepfake videos and fake articles across various online platforms.
Reported: The report explicitly describes privacy violations where victims' contact details were obtained and exploited.
Indirectly caused: PERSON_003's phone number and name were obtained by scammers through a fake online form, leading to persistent harassment with over 60 unsolicited phone calls.
Inferred additional harm: Many of the 400+ reporting victims likely had their personal and financial data harvested and misused by the fraudulent platforms.
Reported: The report explicitly describes psychological distress and harassment experienced by victims of the scam.
Indirectly caused: PERSON_003 experienced significant distress and anxiety after being trolled and called over 60 times by scammers after interacting with the fake article.
Inferred additional harm: It is highly likely that many of the 400+ victims experienced severe anxiety, distress, and embarrassment due to substantial financial losses and aggressive harassment.
Reported: The report explicitly describes epistemic harm through the spread of fake news articles and deepfake videos that mislead the public.
Directly caused: The creation of fake news articles (e.g., fabricating a gossip story about PERSON_004 and Matt Shirvington) and deepfake videos directly corrupted the information environment.
Inferred additional harm: The widespread dissemination of these high-quality deepfakes erodes public trust in digital media and news sources.
Australian consumers lost over $8 million in 2023 to investment scams leveraging AI-generated deepfakes of public figures. While the incident represents a minor national security threat, it highlights the growing capability of malicious actors to exploit synthetic media for widespread financial fraud and social manipulation.