Large language model enhanced framework for systematic reviews and meta-analyses
Abstract
Objective: To evaluate and synthesise current applications of large language models (LLMs) in systematic reviews and meta-analyses (SRMAs), identify key limitations and propose an enhanced theoretical framework to improve the efficiency, scalability and reliability of evidence synthesis.
Methods and analysis: We conducted a narrative review of recent studies applying LLMs across key SRMA stages. A total of 21 publications were analysed for model type, task application, accuracy metrics and workflow impact. Building on this evidence base, we designed a comprehensive LLM-enhanced SRMA framework that categorises LLM roles as consultants and assistants, integrates human-in-the-loop strategies and uses retrieval-augmented generation (RAG) and agent-based architectures to address critical challenges including hallucinations, bias and workflow inefficiency.
Results: The reviewed literature demonstrated that LLMs can support various SRMA tasks with reported accuracy ranging from 61% to 99%, showing particular promise in literature screening and data extraction. Our proposed framework conceptualises modular integration of LLMs across all six SRMA stages, with LLMs serving as consultants for research question formulation and search strategy development and as assistants for task automation including abstract screening and structured data extraction. The framework incorporates RAG technology to reduce hallucinations by grounding outputs in retrieved literature and employs agent-based…
How strong is the evidence?
Evidence Hub reads this as a meta-analysis. Its evidence level is 1 of 5 (Highest · pooled evidence). Pooled evidence from several studies sits at the top of the evidence pyramid.
Read the paper
Related studies
- Strategy for Mitigating DKA Risk in Patients with Type 1 Diabetes on Adjunctive Treatment with SGLT Inhibitors: A STICH Protocol
- Glucoraphanin: a broccoli sprout extract that ameliorates obesity-induced inflammation and insulin resistance
- SGLT2 Inhibitors in Heart Failure: Targeted Metabolomics and Energetic Metabolism
- Mechanisms of blood pressure reduction with sodium-glucose co-transporter 2 (SGLT2) inhibitors
- Sodium-glucose cotransporter inhibitors: beyond glycaemic control
- Decoding the effects of SGLT2 inhibitors on cardiac arrhythmias in heart failure
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.