Can social media forums serve as real-world data for nutraceuticals? Concordance between clinically supported and Reddit-reported ingredient benefits
Abstract
Background: Randomized controlled trials (RCTs) remain the reference standard for establishing clinical efficacy for candidate drugs, but their restrictive eligibility criteria limit generalizability, and for dietary supplements the body of well-powered RCTs is small relative to the number of proposed health claims. Self-reported real-world data (RWD) by patients in social media are increasingly recognized as a complementary evidence source, yet their value in the nutraceutical domain is largely uncharacterized.
Objective: To test whether benefits that users positively report for natural ingredients on Reddit are statistically associated with benefits demonstrated for those ingredients in the clinical-trial literature, and to characterize what a community corpus can reveal about application areas and side effects.
Methods: We assembled a cross-sectional corpus of 216,350 distinct comments from 86 supplement-related subreddits (January 2022 - April 2026), covering 329 canonical ingredients and a shared, MeSH/MedDRA-aligned vocabulary of 581 benefit terms. Comment-level directionality (benefit/no-effect/irrelevant) was assigned by a natural-language-inference model. The independence of clinical efficacy and Reddit endorsement was tested with 2×2 chi-squared and Fisher exact tests across a sweep of endorsement thresholds, plus per-ingredient tests with Bonferroni correction.
Results: Of 31,359 unique (ingredient, benefit) pairs, 2,508 were efficacy-demonstrated under the…
How strong is the evidence?
Evidence Hub reads this as a randomized trial, done in people. Its evidence level is 2 of 5 (High · randomized trial). Randomized trials of a reasonable size are the strongest single-study design.
Read the paper
Related studies
- A Systematic Review and Network Meta-Analysis of Randomized Controlled Trials Evaluating the Evidence Base of Melatonin, Light Exposure, Exercise, and Complementary and Alternative Medicine for Patients with Insomnia Disorder
- Use of Melatonin and/on Ramelteon for the Treatment of Insomnia in Older Adults: A Systematic Review and Meta-Analysis
- Influence of evening light exposure on polysomnographically assessed night-time sleep: A systematic review with meta-analysis
- Use of melatonin in children and adolescents with idiopathic chronic insomnia: a systematic review, meta-analysis, and clinical recommendation
- Significant potential of melatonin therapy in Parkinson’s disease – a meta-analysis of randomized controlled trials
- Meta-Analysis: Melatonin for the Treatment of Primary Sleep Disorders
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.