Systematic Evaluation of Multilingual Retrieval-Augmented Generation for Gastrointestinal Tumor Board Decision Support
Abstract
Abstract Large language models (LLMs) have been proposed as decision support tools for multidisciplinary tumor boards, yet systematic preclinical validation of retrieval-augmented generation (RAG) pipelines remains lacking. In this retrospective framework validation study using real-world clinical data, we applied a modular evaluation framework to 100 gastrointestinal tumor board cases spanning five cancer types, systematically testing 16 configurations varying model variant, multilingual retrieval strategy, query formulation, and corpus scope. Baseline concordance with multidisciplinary team recommendations ranged from 79–85%. Combining query rewriting with curated guideline retrieval improved concordance to 93–95% (p
Read the paper
Related studies
- Knowledge Management Perspective of Generative Artificial Intelligence
- Navigating Generative Artificial Intelligence Promises and Perils for Knowledge and Creative Work
- Characterizing the evolving research on enterprise content management
- Large language models and multimodal foundation models for precision oncology
- From Generative AI to Extended Reality: Multidisciplinary Perspectives on the Challenges, Opportunities, and Future of Educational Computing
- Generative Artificial Intelligence: A New Engine for Advancing Environmental Science and Engineering
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.