Additional Example Questions, Responses, and Evaluations of the PPP RAG Tool
Abstract
This dataset provides four additional examples of users using the EU Peatland Policy Portal's RAG tool in its development phase and their corresponding feedback, with English translations provided alongside questions asked in a different language. This data was collected anonymously as project partners from various disciplines (research, policy, practical restoration) interacted with the RAG tool. The feedback in Question 3 came from one user, Question 4 and Question 5 from a second user, and Question 6 from a third user. The response given in Table Question 3 was evaluated as accurate but not specific enough to be useful. The main critiques of the response in Question 4 were the translation of specific term and the addition of irrelevant documents on top of an otherwise acceptable answer. While brief, the evaluation of Question 5's response is promisingly positive. Finally, the evaluation of the response in Question 6 is mostly negative, but still open to the tool conceptually if the implementation can become more refined.
Read the paper
Related studies
- Knowledge Management Perspective of Generative Artificial Intelligence
- Navigating Generative Artificial Intelligence Promises and Perils for Knowledge and Creative Work
- Characterizing the evolving research on enterprise content management
- Large language models and multimodal foundation models for precision oncology
- From Generative AI to Extended Reality: Multidisciplinary Perspectives on the Challenges, Opportunities, and Future of Educational Computing
- Generative Artificial Intelligence: A New Engine for Advancing Environmental Science and Engineering
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.