TLDR: India’s Chief Justice B.R. Gavai has voiced serious concerns over the misuse of generative AI, particularly deepfakes, within the judiciary. The Supreme Court is now hearing a Public Interest Litigation (PIL) advocating for comprehensive regulations to govern AI’s application in the legal system, citing risks like fabricated case laws, bias, and compromised fairness. The court has adjourned the matter for two weeks to further consider the implications of unregulated AI.
New Delhi, India – In a significant development highlighting the growing challenges posed by advanced technology, India’s Chief Justice B.R. Gavai has brought to the forefront the alarming misuse of generative Artificial Intelligence (AI), specifically deepfakes, within the judicial system. The Supreme Court on Monday commenced hearings on a crucial Public Interest Litigation (PIL) that seeks to establish robust guidelines for the regulation of Generative AI (GenAI) across India’s judiciary.
During the proceedings, Chief Justice Gavai underscored the personal impact of this emerging threat, remarking, “Yes, yes, we have seen our morphed pictures too,” acknowledging that even members of the judiciary have become targets of AI-generated fake content. This statement emphasizes the pervasive nature of deepfake technology and its potential to undermine trust and integrity at the highest levels of governance.
The PIL, which has prompted the Supreme Court’s intervention, raises several critical concerns regarding the unregulated integration of GenAI into the legal ecosystem. Petitioners argue that the “black box” nature of GenAI systems makes them susceptible to producing misleading or entirely fabricated case laws, a phenomenon commonly referred to as “AI hallucination.” Such inaccuracies, the plea warns, could severely compromise the rule of law and infringe upon Article 14 of the Constitution, which guarantees equality before the law.
Furthermore, the petition highlights the risk of GenAI systems perpetuating existing societal biases. If trained on discriminatory data, these AI tools could inadvertently reinforce prejudices against marginalized communities, thereby exacerbating ethical and legal challenges within the judicial system. The plea stresses that the unchecked use of AI in judicial decision-making could ultimately jeopardize fairness and transparency.
The petitioners are advocating for clear mandates to ensure data quality, accountability, and unambiguous ownership in all AI-driven judicial functions. They argue that while AI tools offer potential for increased efficiency, their deployment in a sensitive sector like the judiciary demands stringent oversight to prevent unintended and harmful consequences.
Also Read:
- India’s Digital India Act 2025: Ushering in a New Era of Online Governance and Accountability
- India Debates GenAI Risks: Officials’ Prompts and Citizen Data Security Under Scrutiny
The Supreme Court has adjourned the matter for two weeks, indicating its intent to thoroughly deliberate on the complex issues surrounding AI regulation. This move comes as India, like many nations globally, grapples with the delicate balance of fostering technological innovation while simultaneously establishing safeguards against the misuse of AI. The absence of an overarching AI law in India, a contrast to comprehensive frameworks like the European Union’s AI Act, makes the Supreme Court’s current deliberations particularly pivotal for the future of AI governance in the country. The outcome of this PIL is expected to set a precedent for how India approaches the integration and regulation of AI in its critical public institutions.
