'Man vs. Machine: can ML algorithms diagnose headaches as accurately as clinicians? A systematic review.'
Abstract
Background: Headache disorders are frequently misdiagnosed. We aimed to systematically evaluate the diagnostic accuracy, methodological quality, and clinical applicability of artificial intelligence (AI) and machine learning (ML) models for classifying adult headache disorders against clinician diagnoses using the International Classification of Headache Disorders (ICHD) criteria.
Methods: In this systematic review, we searched PubMed, Embase, and the Cochrane Library (January 2015-December 2025) for AI/ML diagnostic headache studies. Two reviewers extracted data and assessed risk of bias using the QUADAS-2 tool with the QUADAS-AI extension. Main outcomes were sensitivity, specificity, area under the receiver operating characteristic curve (AUC-ROC), and risk of bias.
Results: We included 74 studies encompassing 154,856 participants. Models utilized traditional ML (n = 47), deep learning (n = 18), and hybrid or rule-based approaches (n = 9). Data inputs included neuroimaging (n = 27), multimodal datasets (n = 20), neurophysiological signals (n = 17), and clinical questionnaires (n = 10). Only 4 studies performed independent external validation. Overall sensitivity ranged from 47.5% to 100.0%, specificity from 50.4% to 100.0%, and AUC-ROC from 0.658 to 1.000. Models using structured questionnaires reported realistic accuracies (74-86%), whereas neuroimaging models frequently produced near-perfect, likely overfit estimates. Most studies (65 of 74) exhibited a high risk of bias…
How strong is the evidence?
Evidence Hub reads this as a systematic review, done in people. Its evidence level is 1 of 5 (Highest · pooled evidence). Pooled evidence from several studies sits at the top of the evidence pyramid. Reported size: 154,856 participants or records.
Read the paper
Related studies
- Calcium Ions in the Physiology and Pathology of the Central Nervous System
- AI-powered in silico twins: redefining precision medicine through simulation, personalization, and predictive healthcare
- In silico functional, structural and pathogenicity analysis of missense single nucleotide polymorphisms in human MCM6 gene
- In Silico drug repurposing pipeline using deep learning and structure based approaches in epilepsy
- Targeting serotonin receptors with phytochemicals – an in-silico study
- In silico exploration of anti-prostate cancer compounds from differential expressed genes
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.