Mitigating hallucinations in healthcare AI: a systematic review of evidence-based strategies
Abstract
BACKGROUND: Large language models (LLMs) are increasingly integrated into healthcare applications, but their tendency to generate hallucinations-factually incorrect yet plausible outputs-poses risks to safety and trust. In clinical settings, these failures include fabricated citations, incorrect treatment statements, and inaccurate summaries of patient context, each of which can propagate unsafe decisions.
METHODS: Using the PRISMA systematic review guidelines, we reviewed empirical studies from January 2019 to April 2025 that evaluated hallucination mitigation strategies in LLM-based healthcare AI systems. We searched PubMed, IEEE Xplore, ACM Digital Library, Scopus, Web of Science, and arXiv using predefined terms. Eligible studies were assessed for methodological quality using an adapted Joanna Briggs Institute checklist.
RESULTS: Out of 427 retrieved studies, 44 met inclusion criteria. We identified seven main strategy categories: (1) retrieval-augmented generation (RAG), (2) knowledge graph integration, (3) self-reflection frameworks, (4) specialized evaluation metrics, (5) human-in-the-loop (HITL) approaches, (6) specialized training techniques, and (7) red teaming. The most frequently evaluated strategies were RAG (18/44), knowledge graphs (12/44), and self-reflection or specialized training (10/44 each). RAG approaches demonstrated 30-50% reductions in hallucinations; HITL strategies achieved up to 95% reductions but posed scalability concerns; and red teaming…
How strong is the evidence?
Evidence Hub reads this as a systematic review, done in people. Its evidence level is 1 of 5 (Highest · pooled evidence). Pooled evidence from several studies sits at the top of the evidence pyramid.
Read the paper
Related studies
- Knowledge Management Perspective of Generative Artificial Intelligence
- Navigating Generative Artificial Intelligence Promises and Perils for Knowledge and Creative Work
- Characterizing the evolving research on enterprise content management
- Large language models and multimodal foundation models for precision oncology
- From Generative AI to Extended Reality: Multidisciplinary Perspectives on the Challenges, Opportunities, and Future of Educational Computing
- Generative Artificial Intelligence: A New Engine for Advancing Environmental Science and Engineering
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.