TLDR: Deepfake technology, powered by generative AI, is emerging as a significant threat to India’s democratic processes, undermining voter trust and national security. These sophisticated fabrications are actively reconstructing political reality, making it increasingly difficult for citizens to distinguish truth from fiction, and prompting urgent calls for robust regulatory and detection measures.
The landscape of political discourse in India is facing an unprecedented challenge from the proliferation of deepfake technology, a sophisticated application of generative artificial intelligence. These AI-generated fabrications are no longer a fringe concern, escalating from seemingly innocuous AI-generated images to highly deceptive videos that threaten voter trust, national security, and the very integrity of democratic institutions.
Prime Minister Narendra Modi has explicitly identified deepfakes as ‘one of the greatest threats facing the nation.’ The concern stems from the technology’s ability to reconstruct reality, influencing political narratives and potentially swaying public perception. Instances of this threat are already evident, such as the deepfake of Duwaraka, the deceased daughter of a Tamil Tiger chief, being ‘brought back to life’ to rally support, and a doctored video of Union Home Minister Amit Shah falsely showing him advocating to scrap reservations for Scheduled Castes and Scheduled Tribes.
One of the primary hurdles in combating this menace is the inherent difficulty in detecting deepfakes. Many AI-generated deepfakes are so realistic that they pass as genuine even under scrutiny. Indian police and judicial officers often lack the advanced tools and expertise necessary to accurately identify and prove the falsity of such videos, significantly impeding investigations. Compounding this issue is the anonymity of deepfake creators, who frequently use VPNs or fake accounts to obscure their identities.
In the context of elections, deepfake videos are primarily deployed in two categories: those aimed at creating positive sentiment for a favored candidate and those designed to spread misinformation about the opposition. Groups specifically dedicated to disseminating political propaganda, including deepfake-enabled misinformation, are known as ‘scratch groups’ within electoral campaigning circles.
The broader risks associated with AI in India are significant, with online abuse topping the list at 76 percent, followed closely by deepfakes at 74 percent, scams at 73 percent, and AI hallucinations at 70 percent.
In response to this escalating threat, the Election Commission of India (ECI) has taken proactive measures. In April 2024, the ECI launched a ‘Myth vs Reality Register,’ a comprehensive online repository aimed at debunking fake news related to elections and promoting transparency. Furthermore, in May 2024, the ECI issued specific directives to political parties, emphasizing responsible social media use during campaigning. Legal provisions under the IT Act also carry jail terms of up to three years for offenses such as forgery, promoting rumors, and inciting enmity.
Also Read:
- AI-Generated Family Video Highlights Growing Challenge of Detecting Subtle Digital Imperfections
- India’s AI Transformation: Driving Governance, Public Services, and Economic Growth
Experts propose a ‘Six-Pillar Strategy for India’s Digital Security’ to regulate the risks emanating from generative AI. This includes the urgent need for a comprehensive legal and regulatory framework, such as a dedicated Deepfake and AI Misinformation Act under the Digital India Act. Such legislation would define and criminalize malicious deepfakes, broaden intermediary accountability to include AI tools, and revoke safe harbor immunity for platforms that knowingly spread misinformation. The goal is to enhance digital security and safeguard the democratic process against the evolving threat of AI-driven deception.
