The efficacy, feasibility, and technical outcomes of a GPT-4o-based chatbot Amanda for relationship support: A randomized controlled trial
Abstract
This randomized controlled trial evaluated the efficacy, feasibility, and technical outcomes of Amanda, a GPT-4-based chatbot, in delivering single-session relationship interventions. A total of 258 participants were randomly assigned to engage with either Amanda (n = 130) or a writing task (n = 128) focused on conflict reappraisal. Findings demonstrated significant improvements across 13 of 14 outcome variables—including relationship satisfaction, communication patterns, dyadic coping, problem-specific confidence, and individual well-being—over time in both conditions. Improvements emerged immediately after the intervention and were sustained or continued to improve at the two-week follow-up. However, there were no significant group differences for most outcomes, suggesting that both interventions were comparably effective. One significant group-by-time interaction emerged: participants in the chatbot condition reported lower levels of the partner-demand/self-withdraw communication pattern immediately post-intervention. The writing condition was also associated with lower overall distress about the issue. Feasibility outcomes indicated strong participant engagement with Amanda. Usability was rated highly (M = 4.19/5), as were therapeutic skills (M = 3.99/5) and working alliance (M = 4.75/6). Technical evaluation of interaction transcripts supported these findings, with high coder agreement on Amanda’s empathy, therapeutic questioning, and coherence. However, limitations…
How strong is the evidence?
Evidence Hub reads this as a randomized trial, done in people. Its evidence level is 2 of 5 (High · randomized trial). Randomized trials of a reasonable size are the strongest single-study design. Reported size: 258 participants or records.
Read the paper
Related studies
- Synthesis, In Vitro and In Silico Molecular Docking Studies of Novel Phthalimide–Pyrimidine Hybrid Analogues to Thalidomide as Potent Antitubercular Agents
- Exploring the inhibitory performance of expired moxifloxacin and norfloxacin on copper corrosion in saline environment
- Molecular investigation of antimicrobial peptides against Helicobacter pylori proteins using a peptide-protein docking approach
- Screening of novel narrow-spectrum benzofuroxan derivatives for the treatment of multidrug-resistant tuberculosis through in silico, in vitro, and in vivo approaches
- Synthesis, Characterization, Anticancer, Antioxidant, and In Silico Evaluation of Semicarbazides and Thiosemicarbazides
- Fast and accurate prediction of drug induced proarrhythmic risk with sex specific cardiac emulators
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.