Evidence Hub

Multilingual South Asian Cultural Question Answering Dataset

Fazle Mohammad Tasfiq, Sabab Attin, Sheikh Md. Tahmid Hossain Faiyaz, Raiat Reza, Tanzim Ahmmed

Zenodo (CERN European Organization for Nuclear Research), 2026

Abstract

This dataset contains multilingual question-answering data in five South Asian languages: Bangla, Hindi, Urdu, Tamil, and Nepali. It was developed for evaluating large language models (LLMs) and Retrieval-Augmented Generation (RAG) systems on multilingual and culturally grounded knowledge. The dataset was constructed from titles and contextual passages collected from the corresponding regional Wikipedia editions. For each retained record, a two-line contextual excerpt was derived and supplied to Qwen 3 32B to generate a question whose intended answer is the corresponding article title. The generated questions are preserved as experimental model outputs and may therefore contain ambiguity, title leakage, duplicate wording, punctuation variation, or other generation artifacts. Each record includes the native-language title, translated title fields where applicable, full context, two-line context, generated question, and a topical cluster label. The semantic categories include economics, entertainment, event, food, health, historical, language, locations, material, miscellaneous, organization, people, politics, religion, sports, and temporal. The dataset contains 35,736 records in total: 10,278 Bangla, 8,694 Hindi, 5,806 Urdu, 8,553 Tamil, and 2,405 Nepali entries. This dataset was developed as part of the research project “Analyzing Performance of Retrieval Augmented Generation Models for QA Tasks” at the Department of Computer Science and Engineering, Brac University.

Read the paper

Related studies

Go deeper in Evidence Hub

Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.

Open this study Sign up free