Impact of artificial intelligence on the academic performance and test anxiety of pharmacy students in objective structured clinical examination: a randomized controlled trial
Abstract
The rapid advancement of generative artificial intelligence (AI) in recent years has led to its increased application across various fields including education. One area where AI can significantly impact is clinical education, particularly in the preparation and execution of objective structured clinical examinations (OSCEs). This study aimed to evaluate the impact of AI-generated study material and feedback on the academic performance and level of anxiety of pharmacy students in formative OSCE. This was a 4-week (June–July 2024) randomized controlled study. Students of 6th semester PharmD program were randomized into either an intervention or control group. The intervention group received intervention which comprised a comprehensive training session on how to use AI tools (ChatGPT, Gemini and Perplexity) for generating study materials with personalized feedback, in addition to usual OSCE instructions. The control group only received the usual OSCE instructions. In addition, all students completed the test anxiety inventory (TAI) questionnaire before the OSCE. Eighty-eight (40 male, 48 female) out of 92 (96%) students attended the OSCE and completed the TAI questionnaire. Each group had 44 (50%) students. The mean OSCE mark was 13.26 (± 5.05) out of 30. No significant difference was found between the intervention [12.98 (± 5.15)] and control [13.54 (± 5.00)] groups regarding mean OSCE marks (p = 0.550). Similarly, no significant difference was found between the groups…
How strong is the evidence?
Evidence Hub reads this as a randomized trial, done in people. Its evidence level is 2 of 5 (High · randomized trial). Randomized trials of a reasonable size are the strongest single-study design.
Read the paper
Related studies
- Improving sleep quality leads to better mental health: A meta-analysis of randomised controlled trials
- Tocilizumab in patients with severe COVID-19: a retrospective cohort study
- A new aging measure captures morbidity and mortality risk across diverse subpopulations from NHANES IV: A cohort study
- Fruit, vegetable, and legume intake, and cardiovascular disease and deaths in 18 countries (PURE): a prospective cohort study
- Are noise and air pollution related to the incidence of dementia? A cohort study in London, England
- Long COVID symptoms and duration in SARS-CoV-2 positive children — a nationwide cohort study
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.