Introduction: Deepfake pornography, a disturbing and rapidly growing trend, has become a significant concern for victims and advocates alike. This article explores the challenges faced by individuals targeted by deepfake creators and the potential role of technology companies in curbing the spread of harmful AI-generated content. With the number of deepfake videos increasing exponentially in recent years, it is crucial to address this issue and seek solutions that protect the rights and well-being of victims.
The Rise of Deepfake Pornography: Kaitlyn Siragusa, popularly known as Amouranth, has experienced firsthand the detrimental effects of deepfake pornography. As an Internet personality, she has been targeted by deepfake creators who fabricate explicit videos using her likeness. Siragusa's staff tirelessly files complaints with Google to have these links delisted, but the battle against deepfakes remains constant. Research by Genevieve Oh reveals that the creation of nonconsensual pornographic deepfakes has surged, with nearly 150,000 videos appearing across 30 sites in May 2023, accumulating a staggering 3.8 billion views.
Tech Giants' Involvement: Surprisingly, some of the biggest names in technology, including Google, Amazon, X (formerly Twitter), and Microsoft, indirectly contribute to the proliferation of deepfake pornography. Google drives traffic to deepfake sites through its search engine, while X users regularly circulate deepfaked content. Additionally, Amazon, Cloudflare, and Microsoft's GitHub provide crucial hosting services for these sites. The lack of federal laws criminalizing the creation and sharing of non-consensual deepfake porn in the US further complicates the issue, leaving victims like Siragusa to fend for themselves.
The Call for Tech Company Responsibility: In response to the challenges posed by deepfake pornography, a growing number of tech policy lawyers, academics, and victims are urging tech companies to take responsibility for the content they support. They argue that companies like Google and social media networks should do more to curtail the spread of deepfakes. Victims' best hope for justice lies in pressuring tech companies to delist and de-platform harmful AI-generated content. Brandie Nonnecke, a tech policy expert, emphasizes the need for self-governance within the industry and advocates for checks on the use of individuals' faces and likeness.
The Role of Search Engines and Social Media Networks: Search engines, particularly Google, play a significant role in directing traffic to deepfake sites. Activists argue that Google should exercise more due diligence to prevent explicit and harmful content from appearing in search results. Victims like Siragusa believe that search results for deepfakes should be banned entirely. Similarly, social media networks, such as X, have policies in place to prohibit synthetic and manipulated media. However, deepfake content continues to circulate among users, highlighting the need for stricter enforcement.
Tech Companies' Web Infrastructure Support: Deepfake websites heavily rely on web infrastructure provided by big tech companies. Cloudflare, for instance, hosts 13 of the top 20 deepfake websites, while Amazon provides web hosting services for popular deepfaking tools. Past public pressure campaigns have successfully convinced web services companies to sever ties with controversial sites. Advocates hope that increased pressure on companies hosting deepfake porn sites and tools will yield similar outcomes.
The Responsibility of Technology Tools and Services: The tools used to create deepfakes have become more powerful and accessible, leading to an increase in their misuse. Technology tool developers should take responsibility by explicitly disallowing deepfake materials in their terms of service. Hany Farid, a professor at the University of California, Berkeley, emphasizes the need for technologists to consider the potential harm their tools may cause and take proactive measures to mitigate risks.
Mobile Apps and Payment Processors: Mobile apps play a significant role in the creation and distribution of deepfake pornography. Some apps, innocuously marketed as AI photo animation or photo-enhancing tools, are frequently used to target women online. App stores operated by Apple and Google host these apps, raising concerns about their role in facilitating the creation of deepfakes. Additionally, payment processors like PayPal, Mastercard, and Visa are potential points of pressure for activists seeking to disrupt the flow of deepfakes.
Conclusion: Deepfake pornography poses a significant threat to individuals' privacy, emotional well-being, and reputation. The fight against deepfakes requires a multi-faceted approach, including legal measures, tech company responsibility, and public awareness. Victims' best hope for justice lies in pressuring tech companies to take action and delist harmful AI-generated content. By actively addressing the issue and implementing stricter policies, tech companies can play a crucial role in curbing the spread of deepfake pornography and protecting the rights of individuals.
Ronny M is a content creator under the Newswav Creator programme, where you get to express yourself, be a citizen journalist, and at the same time monetize your content & reach millions of users on Newswav. Log in to creator.newswav.com and become a Newswav Creator now!
The User Content (as defined on Newswav Terms of Use) above including the views expressed and media (pictures, videos, citations etc) were submitted & posted by the author. Newswav is solely an aggregation platform that hosts the User Content. If you have any questions about the content, copyright or other issues of the work, please contact Newswav.