Whose Reality? Consent Boundaries and Free Speech Arguments in the Politics of Generative AI

Sara Concetta Santoriello

doi:10.22151/politikon.42025.2

Authors

Sara Concetta Santoriello University of Naples “Federico II” https://orcid.org/0000-0001-5313-8458

DOI:

https://doi.org/10.22151/politikon.42025.2

Keywords:

Platform Governance, Anti-Woke Discourse, Feminist Technology Ethics, Digital Consent, Deepfakes, Generative AI

Abstract

Generative AI enables creation of increasingly realistic deepfakes that challenge content authenticity assessment. This research examines how anti-woke opinion leaders frame deepfake technology within broader cultural discourse. Through narrative analysis of statements and media between 2018 and 2024, we identify significant inconsistencies in these figures' approaches to consent and bodily autonomy. While championing unrestricted speech when deepfakes target women, minorities, or political opponents, these commentators often advocate for regulation when personally affected. This selective application of principles reveals how deepfake technology disproportionately impacts minoritized groups while reinforcing existing power hierarchies. The research exposes fundamental tensions within anti-woke discourse between freedom of expression and protection from exploitation. Ultimately, deepfakes serve as a lens through which to understand broader ideological inconsistencies around technological governance, highlighting the urgent need for consent-based approaches to synthetic media regulation.

Author Biography

Sara Concetta Santoriello, University of Naples “Federico II”

Sara C. Santoriello is a PhD student in Political Science at the University of Naples “Federico II,” where she works with the Political Science Chair on the ethics of AI, digital identity, and platforms. She is currently a visiting researcher at the Data Justice Lab (JOMEC) at Cardiff University (UK). Her dissertation investigates the role of digital corporations in perpetuating gender, race, and class discrimination, with a specific focus on AI-driven content moderation in social media and educational platforms.

References

Alilunas, Peter. 2024. “What we must be: AI and the future of porn studies.” Porn Studies, 11(1), 99–112. https://doi.org/10.1080/23268743.2024.2312181.

Bandi, Ajay, Pydi Venkata Satya Ramesh Adapa, and Yudu Eswar Vinay Pratap Kumar Kuchi. 2023. "The Power of Generative AI: A Review of Requirements, Models, Input–Output Formats, Evaluation Metrics, and Challenges" Future Internet 15, no. 8: 260. https://doi.org/10.3390/fi15080260.

Backer-White Emily. January 5th, 2024. “Consent Is Core To Porn. Performers Say AI Threatens To Take It Away”. Forbes. https://www.forbes.com/sites/emilybaker-white/2024/01/05/consent-ai-porn/.

Bickert, Monika. 2020. Enforcing Against Manipulated Media. Published on Meta. https://about.fb.com/news/2020/01/enforcing-against-manipulated-media/.

Browne, Jude, Cave, Stephen, Drage, Eleanor, and McInerney, Kerry. 2023. Feminist AI. Critical Perspectives on Data, Algorithms and Intelligent Machines. Oxford: Oxford University Press.

Bowie, Liz, and Griffith, Kristen. March 26th, 2024. Baltimore County Principal’s Racist Comments Faked by AI, Experts Say. Originally published on Baltimore Banner. Retrieved on American Renaissance: https://www.amren.com/news/2024/04/baltimore-county-principals-racist-comments-faked-by-ai-experts-say/.

Cartisano, Marco. October 25th, 2023. “Deepfake porno con Giorgia Meloni, ecco tutti i reati commessi”, Agenda Digitale. https://www.agendadigitale.eu/sicurezza/privacy/deepfake-porno-con-giorgia-meloni-ecco-tutti-i-reati-commessi/.

de Quetteville, Harry. May 14th, 2023. “The Turkish deepfake porn video could change the future of elections”. The Telegraph. https://www.telegraph.co.uk/news/2023/05/14/turkey-deepfake-elections-erdogan-muharrem-ince/

European Commission. 2022. “Regulation on a Single Market For Digital Services and amending Directive 2000/31/EC (Digital Services Act)”.

European Commission. 2024. “Regulation on laying down harmonised rules on Artificial Intelligence (Artificial Intelligence Act) and amending certain Union legislative acts”.

Farid, Hany. 2022. “Creating, Using, Misusing, and Detecting Deep Fakes”. Journal of Online Trust and Safety, Stanford Internet Observatory. https://doi.org/10.54501/jots.v1i4.56.

Goldstein, Josh A., Sastry, Girish, Musser, Micah, DiResta, Renée, Gentzel, Matthew and Sedova, Katerina. 2023. “Generative language models and automated influence operations: Emerging threats and potential mitigations”. arXiv preprint arXiv:2301.04246

Gosse, Chandell E. and Burkell, Jacquelyn. 2020. Politics and porn: how news media characterizes problems presented by deepfakes. Critical Studies in Media Communication, 37(5), 497-511. https://doi.org/10.1080/15295036.2020.1832697.

Granza, Mark. July 2023. In defence of ‘Anons’. IM—1776. https://im1776.com/2023/07/11/in-defense-of-anons/.

Heikkilä, Melissa. 2024. “Bans on deepfakes take us only so far—here’s what we really need”. MIT Technology Review. https://www.technologyreview.com/2024/02/27/1089010/bans-on-deepfakes-take-us-only-so-far-heres-what-we-really-need.

Hibberd, James and Phillips, Zoe G. January 25th, 2024. “Taylor Swift AI Nudes Provoke Fandom Uproar on X: ‘Disgusting as Hell’”. The Hollywood Reporter. https://www.hollywoodreporter.com/news/general-news/taylor-swift-ai-nudes-twitter-x-1235806979/.

Hood, Gregory. March 1st, 2024. “Anti-White AI Is No Laughing Matter”. American Renaissance. https://www.amren.com/features/2024/03/anti-white-ai-is-no-laughing-matter/

Hood, Gregory. May 4th, 2022. “A Contemptible ‘Disinformation Governance Board’”. American Renaissance. https://dev.amren.com/news/2022/05/a-contemptible-disinformation-governance-board/.

Hunter, Tatum. February 13th, 2023. “AI porn is easy to make now. For women, that’s a nightmare”. The Washington Post. https://www.washingtonpost.com/technology/2023/02/13/ai-porn-deepfakes-women-consent/.

Interesse, Giulia. December 20th, 2022. “China to Regulate Deep Synthesis (Deepfake) Technology Starting 2023”. China Briefing. https://www.china-briefing.com/news/china-to-regulate-deep-synthesis-deep-fake-technology-starting-january-2023/.

JRE Daily Clips. 2023. “Joe Rogan: ‘I Wasn’t Afraid of AI Until I Learned This.’” YouTube video, December 19, 2023. Archived at Wayback Machine: https://web.archive.org/web/20231228023448/https://www.youtube.com/watch?v=2yd18z6iSyk.

JRE Daily Clips. 2024. “Joe Rogan & Jordan Peterson: The Dark Triad & 'Lulz' Culture Online.” YouTube video, January 29, 2024. Archived at Wayback Machine: https://web.archive.org/web/20230314161948/https://www.youtube.com/watch?v=n3obXGFknMw.

Lever, Rob. November 29th, 2023. “Deepfake mocks Alexandria Ocasio-Cortez's call for Gaza ceasefire”. AFP Fack Chek. https://factcheck.afp.com/doc.afp.com.34693MW.

Lolli, Alessandro. 2020. La guerra dei meme: fenomenologia di uno scherzo infinito. effequ.

Meskys, Edvinas, Kalpokiene, Julija, Jurcys, Paul, and Liaudanskas, Aidas. 2019. “Regulating Deep Fakes: Legal and Ethical Considerations”. Journal of Intellectual Property Law & Practice 15 (1), 24–31. https://ssrn.com/abstract=3497144.

Nagle, Angela. 2017. Kill all normies: Online culture wars from 4chan and Tumblr to Trump and the alt-right. John Hunt Publishing.

Oversight Board. April 2024. Oversight Board announces two new cases on explicit AI images of female public figures. https://oversightboard.com/news/361856206851167-oversight-board-announces-two-new-cases-on-explicit-ai-images-of-female-public-figures/.

Paris, Britt. 2021. “Configuring Fakes: Digitalized Bodies, the Politics of Evidence and Agency”. Social Media + Society, https://doi.org/10.1177/20563051211062919.

Peterson, Jordan. 2019. “I Didn’t Say That”, Jordanbpeterson.com, 22 August 2019, www.jordanbpeterson.com/blog-posts/i-didnt-say-that (March 24, 2024).

Pierre, Gustavo. 2021. Inside the Twisted World of AOC Deepfake Porn. Countere, 7 April 2021. https://www.countere.com/home/aoc-deepfake-porn.

Postill, John. 2024. The Anthropology of Digital Practices: Dispatches from the Online Culture Wars. Taylor & Francis Ltd.

Reuters Fact Check. 2023. “Video features deepfakes of Nancy Pelosi, Alexandria Ocasio-Cortez and Joe Biden”. Reuters, 28 August 2023. https://www.reuters.com/article/factcheck-pelosi-deepfake-idUSL1N36V2E0/.

Roose, Kevin. 2018. “Here Come the Fake Videos, Too”. The New York Times, 4 March 2018, https://www.nytimes.com/2018/03/04/technology/fake-videos-deepfakes.html.

Rufo, Christopher. 2024. The New Right Activism. IM-1776, 14 January 2024, https://im1776.com/manifesto-counterrevolution/.

SAG-AFTRA. 2024. “SAG-AFTRA Statement on Taylor Swift and George Carlin Digital Fakes”. SAG-AFTRA, 26 January 2024, https://www.sagaftra.org/sag-aftra-statement-taylor-swift-and-george-carlin-digital-fakes.

Scott, Mark. 2024. “Deepfake porn is political violence”. Politico, 8 February 2024, https://www.politico.eu/newsletter/digital-bridge/deepfake-porn-is-political-violence/.

Sayler, Kelly M. and Harris, Laurie A. 2022. “Deep Fakes and National Security”. Congressional Research Services. https://crsreports.congress.gov/product/pdf/IF/IF11333

Sjölin, Catarina. 2015. “Ten years on: consent under the Sexual Offences Act 2003.” The Journal of Criminal Law, 79.1, 20-35, https://doi.org/10.1177/0022018314566744.

Taylor, Jared. “What You Can and Can’t Do With AI”. American Renaissance, 15 February 2024. https://www.amren.com/videos/2024/02/what-you-can-and-cant-do-with-ai/.

Thompson, Stuart A. 2024. “How ‘Deepfake Elon Musk’ Became the Internet’s Biggest Scammer”. New York Times, 14 August 2024, https://www.nytimes.com/interactive/2024/08/14/technology/elon-musk-ai-deepfake-scam.html.

The Economist. 2024. “Is Google’s Gemini chatbot woke by accident, or by design?”. The Economist, 28 February 2024, https://www.economist.com/united-states/2024/02/28/is-googles-gemini-chatbot-woke-by-accident-or-design.

Verdoliva, Luisa. 2020. “Media Forensics and DeepFakes: An Overview”. IEEE Journal on Selected Topics in Signal Processing, 14 (5), https://doi.org/10.1109/JSTSP.2020.3002101.

Verma, Pranshu. 2023. “AI fake nudes are booming. It’s ruining real teens’ lives.”, The Washington Post, 5 November 2023. https://www.washingtonpost.com/technology/2023/11/05/ai-deepfake-porn-teens-women-impact.

Wagner, Travis L. and Blewer, Ashley. 2019. “The Word Real Is No Longer Real”: Deepfakes, Gender, and the Challenges of AI-Altered Video. Open Information Science, 3(1), 32-46. https://doi.org/10.1515/opis-2019-0003.

Timcast. 2024. “Graphic Adult Images Of Taylor Swift GO VIRAL, AI Generated Photos Of Swift Spark OUTRAGE”, YouTube video, January 25, 2024: https://www.youtube.com/watch?v=BRIjBHimzyM.

The Jordan B. Peterson Clip. 2023. “How AI Is Reshaping Society and What Jordan Peterson Has To Say About It”, YouTube video, February 22, 2023: https://www.youtube.com/watch?v=Qh0WQWACCDg.

The Jordan B. Peterson Podcast. 2024. “418. Hedonism, Taboos, Society and Deprivation”, Spotify, January 29, 2024: https://open.spotify.com/episode/3fp3iyBe6hGCpl0oax1yJC (April 28th, 2024).

The Unz Review. 2024. “Rosa Parks and Oprah Are 'Notable White Americans'.” https://www.unz.com/audio/jtaylor_rosa-parks-and-oprah-are-notable-white-americans.

Valuetainment. 2024. “‘Should It Be Illegal?’ - Controversy Over Taylor Swift AI Nude Images”, Youtube video, January 31, 2024: https://www.youtube.com/watch?v=pJ6QhIKrpPc.

Zhang, Angela H. 2024. The Promise and Perils of China's Regulation of Artificial Intelligence. University of Hong Kong Faculty of Law Research Paper, 2024/02. http://dx.doi.org/10.2139/ssrn.4708676.

Žižek, Slavoj. 2024. Instagram post. https://www.instagram.com/p/C3oBTpaBb7O.