Medical visual question answering with multimodal: a systematic mini review (2023-2026)
Abstract
Medical visual question answering (Med-VQA) has emerged as a critical application of artificial intelligence within a short period of time. Large language models (LLMs) and vision-language models (VLMs) have fundamentally rewritten the architecture of medical question answering (QA). This study aims to systematically analyze recent developments in Med-VQA. Like past methods, which were simple, text-heavy database systems, there has been a shift toward multimodal frameworks. Recent methods are now highly capable of explaining radiology, pathology, and dermatological images along with clinical questions. This review was conducted following PRISMA guidelines, covering 27 representative studies published in various databases, using predefined inclusion and exclusion criteria. The findings reveal a clear shift toward generative models, supported by retrieval mechanisms and structured reasoning strategies such as Chain-of-Thought and multi-agent frameworks. Generative models, along with retrieval-augmented generation (RAG) and preference optimization, are not just more consistent than traditional classification-based methods but also can enable free-form clinical question answering. Though frameworks like multi-agent and hierarchical CoT have significantly improved interpretability and mitigated hallucinations, they also come with some limitations, like higher computational time, multi-view analysis, multi-lingual question answering, lack of standardized evaluation and…
Read the paper
Related studies
- Knowledge Management Perspective of Generative Artificial Intelligence
- Navigating Generative Artificial Intelligence Promises and Perils for Knowledge and Creative Work
- Characterizing the evolving research on enterprise content management
- Large language models and multimodal foundation models for precision oncology
- From Generative AI to Extended Reality: Multidisciplinary Perspectives on the Challenges, Opportunities, and Future of Educational Computing
- Generative Artificial Intelligence: A New Engine for Advancing Environmental Science and Engineering
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.