About

Pennsylvania sues Character.AI over chatbot allegedly posing as licensed psychiatrist

Published
Score
10

Why it matters

Pennsylvania's Department of State and State Board of Medicine have filed a Petition for Review in Commonwealth Court against Character Technologies, Inc., alleging that the company's AI chatbot platform violates the state's Medical Practice Act by engaging in the unauthorized practice of medicine. According to the complaint, state investigators discovered an AI character named "Emilie" that presented itself as a psychology and psychiatry specialist, claimed authority to conduct medical school assessments and depression evaluations, and provided a false Pennsylvania medical license number. The state is seeking injunctive relief to halt the conduct.

The complaint centers on Character.AI's core functionality: a platform allowing users to create and interact with AI "characters," some of which present as doctors or mental health professionals. The specific representations made by the Emilie character—including the false license number—form the basis of the unauthorized practice allegation. The scope of any broader enforcement action against other characters on the platform remains unclear.

For practitioners, this case signals that state medical boards are prepared to apply existing licensing statutes to consumer-facing AI systems. Pennsylvania's action is among the first state enforcement efforts targeting AI companion platforms for health-related impersonation and may establish precedent for how professional-licensing laws apply to generative AI. Attorneys advising health tech companies or AI platforms should monitor Commonwealth Court's treatment of whether traditional medical practice statutes can reach AI systems that lack licensure but hold themselves out as qualified professionals.

mail Subscribe to Health Care email updates

Primary sources. No fluff. Straight to your inbox.

Also on LawSnap