Pennsylvania sues AI company, saying its chatbots illegally hold themselves out as licensed doctors

Pennsylvania AG files first-of-its-kind consumer protection lawsuit against an AI chatbot company for misrepresenting its systems as licensed medical professionals. The complaint targets deceptive persona design where chatbots explicitly claim clinical credentials, violating state medical practice statutes. ML engineers deploying health-focused LLMs must now audit system prompts, persona configurations, and disclaimer logic for regulatory compliance. This signals incoming legal precedent that will directly constrain how conversational AI systems are scoped, prompted, and deployed in healthcare verticals.