The Australian eSafety Commissioner has called for urgent action from major technology companies, including Meta and Snapchat, to combat a surge in sextortion cases, citing over 2,200 reported incidents in six months. The regulator has demanded the implementation of AI-driven detection systems and warned of potential fines exceeding $54.6 million for non-compliance. These measures aim to address a growing threat where perpetrators exploit digital platforms to extort victims through threats of sharing explicit content.
According to a 2023 report by the eSafety Commissioner, the number of sextortion cases in Australia has risen sharply, with victims often targeted through social media, messaging apps, and online gaming platforms. The report highlights that 68% of cases involve minors, though adults are also frequent targets. “This is a crisis that demands immediate and enforceable solutions,” said eSafety Commissioner Julie Inman Grant in a statement. “We are not asking for the impossible—AI technology exists to detect and prevent these crimes, but it must be deployed effectively.”
The regulator has specifically targeted Meta (parent company of Facebook and Instagram) and Snapchat, citing their platforms as common venues for sextortion. A leaked internal document obtained by The Guardian reveals that eSafety has issued formal notices to these companies, requiring them to submit detailed plans for AI-based content moderation by October 31, 2024. Failure to comply could result in penalties under Australia’s Online Safety Act 2021, which authorizes fines of up to 10% of a company’s global revenue for repeated violations.
Rise in Sextortion Cases and Platform Vulnerabilities
Sextortion, a form of cybercrime where perpetrators coerce victims into sending explicit images or videos under threat of exposure, has become increasingly prevalent in the digital age. A 2023 study by the Australian Institute of Criminology found that 73% of sextortion victims reported encountering perpetrators on social media platforms, with 45% of cases involving fake profiles created to groom targets. “These platforms are not just passive tools—they are enabling environments for exploitation,” said Dr. Emily Carter, a cybersecurity researcher at the University of Melbourne.
Meta and Snapchat have faced scrutiny for their content moderation policies. In 2022, a whistleblower from Meta’s Trust and Safety team alleged that the company’s AI systems were underutilized to detect sextortion-related content. “We have the technology to flag suspicious conversations, but it’s often deprioritized in favor of revenue-driven algorithms,” the source said. Snapchat, meanwhile, has been criticized for its “Snap Map” feature, which allows users to share real-time locations and has been exploited by predators to identify vulnerable individuals.
eSafety’s demand for AI-driven solutions aligns with broader global trends in digital regulation. The European Union’s Digital Services Act (DSA), which took effect in 2023, requires platforms to implement “proportionate and effective” measures to combat illegal content, including sextortion. Australia’s approach mirrors these efforts but introduces stricter financial penalties, with fines capped at 10% of a company’s global revenue—a measure that could be particularly impactful for Meta, which reported $116.6 billion in 2023 revenue.
Regulatory Pressure and Industry Response
In response to eSafety’s demands, Meta has announced plans to expand its AI moderation tools. A spokesperson stated, “We are continuously investing in technologies to detect and remove harmful content, including sextortion-related material. We are engaging with regulators to ensure our efforts align with Australia’s legal framework.” The company also highlighted its partnership with the Australian Federal Police (AFP) to develop a shared database of known sextortion networks.
Snapchat has taken a more cautious stance, emphasizing its commitment to user safety while noting the challenges of balancing privacy and security. “We are exploring AI solutions that can identify harmful behavior without compromising user confidentiality,” a spokesperson said. The company has also introduced new reporting features, including an AI-powered tool that automatically flags conversations containing keywords associated with sextortion.
However, critics argue that these measures are insufficient. “Fines alone won’t solve the problem,” said Sarah Mitchell, a legal expert at the Australian Human Rights Commission. “What’s needed is a comprehensive strategy that includes education, victim support, and stricter enforcement of existing laws. Platforms must be held accountable not just for their technology, but for the ecosystems they enable.”
Impact on Victims and Broader Implications
The psychological and financial toll of sextortion on victims is profound. A 2023 survey by the Australian Psychological Society found that 78% of victims experienced long-term anxiety, while 42% reported financial losses due to ransom demands. Many victims also face reputational damage, with explicit content shared on public platforms leading to workplace discrimination or social ostracization.
eSafety has launched a dedicated support portal for victims, offering free legal advice, mental health resources, and guidance on reporting incidents. The agency also collaborates with schools and community organizations to educate young people about online safety. “Prevention is as critical as punishment,” said Inman Grant. “We need to empower users to recognize and resist predatory behavior.”
The regulatory push in Australia has sparked debates about the role of tech companies in preventing crime. While some argue that platforms should bear greater responsibility for user safety, others warn against overregulation that could stifle innovation. “There’s a fine line between accountability and censorship,” said Mark Thompson, a tech policy analyst at the Sydney Institute. “Regulators must ensure that solutions are both effective and respectful of user rights.”
Next Steps and Global Context
eSafety has scheduled a public hearing on September 15, 2024, to review progress on the AI implementation plans from major platforms. The hearing will include testimony from industry representatives, victim advocates, and cybersecurity experts. “This is a pivotal moment for online safety,” said Inman Grant. “We must ensure that technology serves as a tool for empowerment, not exploitation.”
As Australia strengthens its regulatory framework, the global debate over digital accountability continues. The United States, for example, has seen growing calls for federal legislation targeting sextortion, while the UK has introduced new guidelines for social media companies. These developments underscore the urgent need for international cooperation to address a crime that transcends borders.
For now, the focus remains on Australia’s eSafety Commissioner and the pressure it is exerting on tech giants. Whether the proposed AI solutions will effectively curb sextortion remains to be seen, but the stakes for victims—and for the future of online safety—are undeniable.
Call to Action: Stay informed about the latest developments in online safety by visiting the eSafety Commissioner’s official website. Share your thoughts on the measures being proposed and how they might impact digital platforms in Australia and beyond.
Related reading