Included Health has published a new Healthcare AI Framework designed for safe patient-facing generative AI. The framework appears in a peer-reviewed paper published by NEJM Catalyst Innovations in Care Delivery. The healthcare company developed the model to support patients with routine health questions. At the same time, it directs higher-risk situations to qualified clinicians. Consequently, patients will get advice from people who have the necessary expertise on time.
Secondly, it should be noted that this research presents a different paradigm of AI in medicine. Consequently, it aims to improve trust in patient-facing technology. According to Included Health, the system follows four key principles. These include executive-backed governance and clinical oversight. The framework also includes proactive risk analysis before deployment. In addition, it uses a three-tier risk classification process. Furthermore, clinicians continuously review interactions to improve performance.
“At Included Health, we believe healthcare AI should be held to a higher standard than general-purpose tools. People deserve timely support, but they also need a model they can trust to provide accurate, safe guidance,” said Ami Parekh, MD, chief health officer at Included Health. “That means building for the realities of care from the start — being clear about what AI should and should not do, recognizing when risk is higher, and making sure clinical expertise is part of the experience when it matters most.”
“We believe the framework described in this paper offers a practical blueprint for how healthcare organizations can deploy patient-facing AI with safety, transparency, and human oversight built in from the start,” said Ankoor Shah, MD, vice president of clinical excellence at Included Health. “That is the standard this industry should be building toward — and the kind of governance that can help raise the bar for how these tools are deployed and trusted across healthcare.”
Pilot Demonstrates Strong Safety Results
During a seven-week pilot, Included Health deployed the assistant to half of its patient population. Meanwhile, clinicians reviewed every clinical interaction each day. The review process maintained strong safety standards throughout the program.
The company reported a 65% reduction in unnecessary handoffs for standard-risk questions. Therefore, more members received immediate and clinically appropriate guidance. Patient satisfaction remained consistent with that of the comparison group.
The framework of Healthcare AI Framework embodies the overall AI + EQ approach of Included Health. It also aligns with the increasing demand for responsible AI.
Explore Health Tech Insiders for the latest medical innovations and reliable strategic insights driving the future of technology-driven healthcare transformation.
News Source: Businesswire.com
