Evidence Hub

ConsRAG: Minimize LLM Hallucinations in the Legal Domain

Ha-Thanh Nguyen, Ken Satoh

Frontiers in artificial intelligence and applications, 2024

3 citations

Abstract

Retrieval-Augmented Generation (RAG) systems have shown potential in improving legal question-answering applications. However, they often struggle to provide precise information for legal queries, as broad-topic relevance may not always align with contextual usefulness. To address this challenge, we introduce Constrained Retrieval-Augmented Generation (ConsRAG), a novel approach that employs aspect-based constraints during both retrieval and generation phases. ConsRAG aims to enhance precision and contextual relevance in legal outputs through these constraints and an iterative backtracking mechanism. Our experiments suggest that ConsRAG may offer improvements over existing systems in terms of accuracy and relevance of retrieved documents. This paper presents the framework, implementation, and evaluation of ConsRAG, exploring its potential to enhance the reliability of legal AI applications.

Read the paper

Related studies

Go deeper in Evidence Hub

Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.

Open this study Sign up free