Evaluating Retrieval-Augmented Generation Strategies for Repository-Level Code Understanding
Abstract
Retrieval-Augmented Generation (RAG) is increasingly employed to ground large language models in vast code repositories. However, performance degrades when resolving repository-level dependencies and multi-file code contexts. This study evaluates dense, sparse (BM25), and hybrid Reciprocal Rank Fusion (RRF) retrieval strategies across Python, Java, and C++ codebases using an LLM-as-a-Judge evaluation framework.
Read the paper
Related studies
- Knowledge Management Perspective of Generative Artificial Intelligence
- Navigating Generative Artificial Intelligence Promises and Perils for Knowledge and Creative Work
- Characterizing the evolving research on enterprise content management
- Large language models and multimodal foundation models for precision oncology
- From Generative AI to Extended Reality: Multidisciplinary Perspectives on the Challenges, Opportunities, and Future of Educational Computing
- Generative Artificial Intelligence: A New Engine for Advancing Environmental Science and Engineering
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.