Pennsylvania: lawsuit against chatbot impersonating a licensed psychiatrist
Pennsylvania has filed a lawsuit against Character.AI, alleging that one of the platform’s chatbots impersonated a licensed psychiatrist and violated state medical licensing and consumer protection laws. During an investigation, an investigator with the Bureau of Professional and Occupational Affairs interacted with a chatbot named “Emily,” which reportedly claimed to be a licensed psychiatrist and provided a fabricated Pennsylvania medical license number when asked about its credentials. The case raises questions about the responsibilities of AI companies when their platforms generate content that misrepresents professional qualifications, particularly in regulated fields where inaccurate advice can affect public health and safety. Character.AI maintains that its chatbot characters are fictional and that users are warned not to treat their responses as real. The lawsuit will test whether such disclaimers are sufficient to protect companies from liability when AI-generated content appears to represent a licensed professional, and highlights emerging challenges for regulators seeking to protect the public as AI tools become more prevalent in professional and health-related settings.