Evidence Hub

Chain of thoughts, Tree of thoughts and Retrieval Augmented thoughts

Nabil Moncef Boukhatem, Davide Buscaldi, Leo Liberti

HAL (Le Centre pour la Communication Scientifique Directe), 2024

Abstract

This paper presents novel contributions to improving large language models (LLMs) through the integration and enhancement of three reasoning frameworks: Chain-of-Thoughts (CoT), Tree-of-Thoughts (ToT), and Retrieval-Augmented Thoughts (RAT). CoT generates linear intermediate reasoning steps, ToT introduces a branching structure for exploring multiple reasoning pathways, and RAT incorporates real-time external knowledge retrieval. A key innovation discussed is the use of decision trees, both handcrafted and automatically generated, to guide and validate the reasoning processes of CoT and ToT. This approach enhances the interpretability, accuracy, and adaptability of LLMs, particularly in complex problem-solving tasks like medical diagnostics and financial forecasting.

Read the paper

Related studies

Go deeper in Evidence Hub

Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.

Open this study Sign up free