AI Chatbot for Cancer Patient Support: Development and Evaluation Using Llama 3.1, Mistral 7B, and PHI 3B
Abstract
This study develops and evaluates a question-answering (Q&A) system for breast cancer patients using generative AI technologies. We compared the performance of three language models-Llama 3.1, Mistral 7B and Phi 3.5. The goal is to integrate this system into a patient-facing application, providing personalised, interactive support based on reliable sources such as Cancer Research UK. However, findings indicate that misinformation remains a significant concern. Medical chatbots utilising retrieval augmented generation (RAG) providing clinical information require significant refinement before being suitable for clinical use.
Read the paper
Related studies
- Knowledge Management Perspective of Generative Artificial Intelligence
- Navigating Generative Artificial Intelligence Promises and Perils for Knowledge and Creative Work
- Characterizing the evolving research on enterprise content management
- Large language models and multimodal foundation models for precision oncology
- From Generative AI to Extended Reality: Multidisciplinary Perspectives on the Challenges, Opportunities, and Future of Educational Computing
- Generative Artificial Intelligence: A New Engine for Advancing Environmental Science and Engineering
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.