The rapid advancement of Generative Adversarial Networks (GANs), a subset of artificial intelligence (AI), has enabled the creation of highly realistic synthetic media known as deepfakes. While this technology offers innovative applications, it also presents significant legal and ethical challenges, especially in the creation of nonconsensual pornographic content and so-called revenge pornography, endangering factual and legal safety, particularly for women. In this context, this article examines the legal and ethical implications of deepfakes, focusing on existing regulatory frameworks and proposing measures to mitigate their misuse as a means to advance the United Nations Sustainable Development Goal (SDG) number 5: achieving gender equality and the empowerment of all women and girls. Accordingly, we analyze methods for detecting GAN-generated images and ongoing legal initiatives, which reveal the need for a balanced approach combining technical solutions, legal accountability, and public awareness. Our findings highlight the urgency of regulatory updates and technological innovations to protect individual rights, democratic integrity, and women’s freedom in the era of AI-generated content.