AI tutoring outperforms in-class active learning: an RCT introducing a novel research-based design in an authentic educational setting
Abstract
Advances in generative artificial intelligence show great potential for improving education. Yet little is known about how this new technology should be used and how effective it can be compared to current best practices. Here we report a randomized, controlled trial measuring college students’ learning and their perceptions when content is presented through an AI-powered tutor compared with an active learning class. The novel design of the custom AI tutor is informed by the same pedagogical best practices as employed in the in-class lessons. We find that students learn significantly more in less time when using the AI tutor, compared with the in-class active learning. They also feel more engaged and more motivated. These findings offer empirical evidence for the efficacy of a widely accessible AI-powered pedagogy in significantly enhancing learning outcomes, presenting a compelling case for its broad adoption in learning environments.
How strong is the evidence?
Evidence Hub reads this as a randomized trial. Its evidence level is 2 of 5 (High · randomized trial). Randomized trials of a reasonable size are the strongest single-study design.
Read the paper
Related studies
- Comparison of the Effects of Glucagon-Like Peptide Receptor Agonists and Sodium-Glucose Cotransporter 2 Inhibitors for Prevention of Major Adverse Cardiovascular and Renal Outcomes in Type 2 Diabetes Mellitus: Systematic Review and Meta-Analysis of Cardiovascular Outcomes Trials
- Efficacy of personalized psychological interventions: A systematic review and meta-analysis
- Effects of Lifestyle Interventions That Include a Physical Activity Component in Class II and III Obese Individuals: A Systematic Review and Meta-Analysis
- Blood pressure lowering and risk of new-onset type 2 diabetes: an individual participant data meta-analysis
- Topical treatments for atopic dermatitis (eczema): systematic review and network meta-analysis of randomized trials
- Comparative efficacy and tolerability of pharmacological interventions for acute bipolar depression in adults: a systematic review and network meta-analysis
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.