Dataset Fragmentation, Cognitive Variability, and Reproducibility Challenges in EEG-Based Brain-Computer Interfaces: A PRISMA-Based Systematic Review
Abstract
Public EEG-based brain-computer interface (BCI) datasets are expanding rapidly, yet differences in sensors, experimental protocols, task/event semantics, preprocessing, participant context, and evaluation limit reproducibility and cross-dataset learning. This review examined whether heterogeneous EEG-BCI resources can support reproducible analysis across sources. A PRISMA-based systematic mapping review of literature published from 2014 to June 2026 was conducted across Scopus, Web of Science Core Collection, IEEE Xplore, PubMed, and ACM Digital Library, yielding 16,920 records. Following screening and evidence-focused curation, a curated synthesis corpus of 129 publications was retained and confirmed by full-text review. Evidence was coded across structural, semantic, procedural, human/contextual, and computational fragmentation, and reporting transparency was assessed using ten criteria. The synthesis identified heterogeneity in acquisition, channel layouts, task/event definitions, preprocessing, participant/session context, and evaluation design. Existing standards, ontologies, software platforms, benchmark frameworks, and transfer-learning methods address complementary layers but do not provide complete semantic interoperability. Within the retained corpus, the median transparency score was 9/10; data availability was stated in 61.2% and code or pipeline availability in 20.9%. These frequencies describe the curated corpus rather than the field as a whole. Scalable…
How strong is the evidence?
Evidence Hub reads this as a systematic review, done in people. Its evidence level is 1 of 5 (Highest · pooled evidence). Pooled evidence from several studies sits at the top of the evidence pyramid.
Read the paper
Related studies
- Knowledge Management Perspective of Generative Artificial Intelligence
- Navigating Generative Artificial Intelligence Promises and Perils for Knowledge and Creative Work
- Characterizing the evolving research on enterprise content management
- Large language models and multimodal foundation models for precision oncology
- From Generative AI to Extended Reality: Multidisciplinary Perspectives on the Challenges, Opportunities, and Future of Educational Computing
- Generative Artificial Intelligence: A New Engine for Advancing Environmental Science and Engineering
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.