Performance of federated learning models in health services research: A systematic review and meta-analysis
Abstract
Purpose: This study aimed to assess the performance of federated learning (FL) models and compare their performance with local and centralized models.
Methods: We conducted a systematic search of Ovid MEDLINE and PubMed from inception to June 10, 2025, to identify studies using patient data to train or validate FL algorithms and reporting at least one model performance outcome. Two reviewers independently screened articles and extracted data on study characteristics, FL frameworks and model training methodologies, and reported performance metrics. We summarized model performance using medians and interquartile ranges for federated, local, and centralized models. Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Diagnostic Test Accuracy Studies was followed.
Results: Thirteen studies involving 247 sites and 158,435 samples were included, with eight studies contributing to this meta-analysis. Most FL models (85%) used the Federated Averaging (FedAvg) algorithm for parameter aggregation across sites. FL model performance metrics were compared with local and centralized models within each machine learning task in each study. FL showed notable gains over local models, improving the AUC by 8.2%, F1 score by 7.9%, sensitivity by 4.1%, PPV by 26.1%, and PRAUC by 1.6%. Compared with centralized models, FL showed modest losses of 4.1% in AUC, 9.9% in F1 score, 9.3% in sensitivity, and 2.8% in PRAUC.
Conclusions: FL outperformed local models and…
How strong is the evidence?
Evidence Hub reads this as a meta-analysis. Its evidence level is 1 of 5 (Highest · pooled evidence). Pooled evidence from several studies sits at the top of the evidence pyramid.
Read the paper
Related studies
- Active Learning during Federated Learning for Object Detection
- Fairness-aware federated learning
- Decentralized Federated Learning
- Building a Personally Identifiable Information Recognizer in a Privacy Preserved Manner Using Automated Annotation and Federated Learning
- Preservation of Patient Level Privacy: Federated Classification and Calibration Models
- Efficient explainable federated learning
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.