Evaluation Vector Database (ChromaDB) for Multi-Hop QA Generation based on The Guardian News Data
Abstract
This dataset contains a pre-computed ChromaDB vector database created for the evaluation of Retrieval-Augmented Generation (RAG) systems in multi-hop, multi-turn scenarios. It was developed as part of a Master's thesis extending the RAG-DIVE evaluation framework of Brehme et al. (2026) Data Source & Processing: Source: The Guardian Open Platform API. Timeframe: 01 January 2026 to 20 April 2026 (collected to ensure a strict zero-shot evaluation environment for LLMs with a 2025 parametric knowledge cutoff). Processing: The raw articles were processed using recursive character chunking (chunk size: 1000, overlap: 150) and embedded using Google's gemini-embedding-001 model. Chunks are explicitly enriched with metadata (headline, date, and a parent article_id) to technically support the stochastic multi-hop context progression mechanism. Copyright Notice & Access Restriction: The original text content and copyright of the news articles belong entirely to The Guardian. The data was accessed and processed exclusively for non-commercial, academic research purposes. Due to The Guardian's Terms of Service regarding the redistribution and sub-licensing of their content, this dataset cannot be published as Open Access. Access is provided strictly to thesis reviewers and authorised researchers for the purpose of scientific reproducibility. Please use the "Request Access" button and state your academic affiliation and purpose.
Read the paper
Related studies
- Knowledge Management Perspective of Generative Artificial Intelligence
- Navigating Generative Artificial Intelligence Promises and Perils for Knowledge and Creative Work
- Characterizing the evolving research on enterprise content management
- Large language models and multimodal foundation models for precision oncology
- From Generative AI to Extended Reality: Multidisciplinary Perspectives on the Challenges, Opportunities, and Future of Educational Computing
- Generative Artificial Intelligence: A New Engine for Advancing Environmental Science and Engineering
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.