Capabilities of Gemini Models in Medicine
Abstract
Excellence in a wide variety of medical applications poses considerable challenges for AI, requiring advanced reasoning, access to up-to-date medical knowledge and understanding of complex multimodal data. Gemini models, with strong general capabilities in multimodal and long-context reasoning, offer exciting possibilities in medicine. Building on these core strengths of Gemini, we introduce Med-Gemini, a family of highly capable multimodal models that are specialized in medicine with the ability to seamlessly use web search, and that can be efficiently tailored to novel modalities using custom encoders. We evaluate Med-Gemini on 14 medical benchmarks, establishing new state-of-the-art (SoTA) performance on 10 of them, and surpass the GPT-4 model family on every benchmark where a direct comparison is viable, often by a wide margin. On the popular MedQA (USMLE) benchmark, our best-performing Med-Gemini model achieves SoTA performance of 91.1% accuracy, using a novel uncertainty-guided search strategy. On 7 multimodal benchmarks including NEJM Image Challenges and MMMU (health & medicine), Med-Gemini improves over GPT-4V by an average relative margin of 44.5%. We demonstrate the effectiveness of Med-Gemini's long-context capabilities through SoTA performance on a needle-in-a-haystack retrieval task from long de-identified health records and medical video question answering, surpassing prior bespoke methods using only in-context learning. Finally, Med-Gemini's performance…
Read the paper
Related studies
- Severe clinical outcomes of COVID-19 associated with proton pump inhibitors: a nationwide cohort study with propensity score matching
- Ferulic acid regulates the AKT/GSK-3β/CRMP-2 signaling pathway in a middle cerebral artery occlusion animal model
- Association between cord blood 25-hydroxyvitamin D concentrations and respiratory tract infections in the first 6 months of age in a Korean population: a birth cohort study (COCOA)
- Novel Pharmacokinetic/Pharmacodynamic Parameters Quantify the Exposure–Effect Relationship of Levofloxacin against Fluoroquinolone-Resistant Escherichia coli
- Neuroprotective Effects of Epicatechin against Oxidative Stress-Induced Cognitive Impairment: A Systematic Review and Meta-Analysis
- Photochemical behavior of levofloxacin
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.