Reply to Daungsupawong and Wiwanitkit
Abstract
Letter to: Comment on “Using a customized GPT to provide guideline-based recommendations for management of pancreatic cystic lesions” Endosc Int Open 2024; 12(06): E810-E810 DOI: 10.1055/a-2335-8369 10.1055/a-2335-8369 Dear Editor, Dr. Ray, and Dr. Wiwanitkit I have carefully read your letter and the important issues raised in it regarding our work on the evaluation of custom ChatGPT agents in the management of pancreatic cystic lesions [ 1 ] [ 2 ]. I agree with the limitations you have pointed out, keeping in mind that this study is intended as a proof of concept for a novel feature of large language models (LLMs). Although 60 scenarios is not a large sample size, most similar studies in the field of gastroenterology and LLMs studied a similar number of scenarios [ 3 ] [ 4 ] [ 5 ]. The issue of interrogation of discrepancies as part of a systemic approach to the development and training of LLMs should indeed be further implemented and improved. An example of such a systemic approach is described in a recent work that evaluated various setups using ChatGPT for management of hepatitis C infection [ 5 ]. The ethical considerations including bias and error handling and user responsibility should also be explored. Hopefully, these issues will be addressed gradually in future studies as this field of currently novel research progresses from generated scenarios to evaluation on clinical data and prospective interventional studies. Publication History Received: 07 May 2024…
Read the paper
Related studies
- Knowledge Management Perspective of Generative Artificial Intelligence
- Navigating Generative Artificial Intelligence Promises and Perils for Knowledge and Creative Work
- Characterizing the evolving research on enterprise content management
- Large language models and multimodal foundation models for precision oncology
- From Generative AI to Extended Reality: Multidisciplinary Perspectives on the Challenges, Opportunities, and Future of Educational Computing
- Generative Artificial Intelligence: A New Engine for Advancing Environmental Science and Engineering
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.