TLDR: Illinois has become the first U.S. state to enact a comprehensive law, the Wellness and Oversight for Psychological Resources Act, banning artificial intelligence platforms like ChatGPT from independently providing therapy or mental health assessments. The legislation, signed by Governor J.B. Pritzker, aims to safeguard patients from the potential dangers of unregulated AI advice, emphasizing that AI should assist, not replace, licensed mental health professionals.
In a landmark move, Illinois has enacted the Wellness and Oversight for Psychological Resources Act (HB 1806), making it the first U.S. state to significantly regulate the use of artificial intelligence in mental healthcare. Signed into law by Governor J.B. Pritzker, this groundbreaking legislation prohibits AI platforms, including popular chatbots like ChatGPT, from offering therapy or conducting mental health assessments without direct supervision from licensed professionals.
The new law addresses growing ethical and safety concerns surrounding the expanding role of AI in sensitive healthcare fields. It comes amid increasing reports of individuals turning to AI for mental health support, sometimes with dangerous consequences, including instances where AI therapists have reportedly overlooked or even encouraged self-harm and suicidal ideation. Illinois State Representative Bob Morgan stated, ‘We have already heard the horror stories when artificial intelligence pretends to be a licensed therapist. Individuals in crisis unknowingly turned to AI for help and were pushed toward dangerous, even lethal, behaviors.’
Under the Wellness and Oversight for Psychological Resources Act, AI tools are explicitly barred from performing core therapeutic functions such as recommending treatment plans, making mental health evaluations, or offering counseling and therapy services independently. The law mandates that any therapeutic communication or decision-making must be overseen by a qualified human professional.
However, the legislation does not impose a complete ban on AI in mental healthcare. It includes specific carve-outs that permit AI to be used for ‘supplemental support’ and administrative tasks. This includes managing appointments, handling billing, assisting with documentation, analyzing data under human review, and providing general wellness tips or frequently asked questions. The intent is clear: AI should ‘assist, not replace’ the nuanced understanding, empathy, and accountability that human professionals bring to mental health treatment.
Violations of the new law carry steep penalties, with companies or individual practitioners facing fines of up to $10,000 per offense. Enforcement will be carried out by the Illinois Department of Financial and Professional Regulation (IDFPR). Mario Treto, Jr., Secretary of the IDFPR, underscored the state’s commitment, stating, ‘The people of Illinois deserve quality healthcare from real, qualified professionals and not computer programs that pull information from all corners of the internet to generate responses that harm patients.’
Also Read:
- States Forge Ahead with AI Governance Amidst Federal Regulatory Vacuum
- The Perilous Path: How AI Chatbots Can Induce Delusional Spirals in Users
This pioneering legislation by Illinois is expected to set a significant precedent for future national and international regulatory frameworks concerning AI in healthcare. Concerns about unregulated AI in therapy have also been voiced by organizations like the American Psychological Association (APA), which has warned federal agencies about AI chatbots posing as therapists. As more AI-powered wellness apps and chatbots emerge, Illinois has taken a decisive stand, ensuring that while machines can assist, human expertise and oversight remain paramount in mental health care.
