Evaluating responses by ChatGPT to farmers' questions on irrigated lowland rice cultivation in Nigeria
Abstract
The limited number of agricultural extension agents (EAs) in sub-Saharan Africa limits farmers' access to extension services. Artificial intelligence (AI) assistants could potentially aid in providing answers to farmers' questions. The objective of this study was to evaluate the ability of an AI chatbot assistant (ChatGPT) to provide quality responses to farmers' questions. We compiled a list of 32 questions related to irrigated rice cultivation from farmers in Kano State, Nigeria. Six EAs from the state were randomly selected to answer these questions. Their answers, along with those of ChatGPT, were assessed by four evaluators in terms of quality and local relevancy. Overall, chatbot responses were rated significantly higher quality than EAs' responses. Chatbot responses received the best score nearly six times as often as the EAs' (40% vs. 7%). The evaluators preferred chatbot responses to EAs in 78% of cases. The topics for which the chatbot responses received poorer scores than those by EAs included planting time, seed rate, and fertilizer application rate and timing. In conclusion, while the chatbot could offer an alternative source for providing agricultural advisory services to farmers, incorporating site-specific input rate-and-timing agronomic practices into AI assistants is critical for their direct use by farmers.
Read the paper
Related studies
- Meta-analysis and the science of research synthesis
- Rapid and sustained symptom reduction following psilocybin treatment for anxiety and depression in patients with life-threatening cancer: a randomized controlled trial
- Cluster Randomized Controlled Trial
- Convalescent plasma in patients admitted to hospital with COVID-19 (RECOVERY): a randomised controlled, open-label, platform trial
- Disease Free Survival and Local Recurrence for Laparoscopic Resection Compared to Open Resection of Stage II-III Rectal Cancer: Follow up Results of the ACOSOG Z6051 Randomized Controlled Trial
- The effects of a course of intranasal oxytocin on social behaviors in youth diagnosed with autism spectrum disorders: a randomized controlled trial
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.