SPARROW: An AR-RAG Tool for Immersive Information Retrieval in Smart Manufacturing
Abstract
We introduce SPARROW, an immersive information retrieval tool for smart manufacturing. The tool explores the potential of combining Augmented Reality with Retrieval-Augmented Generation to create an immersive information retrieval system. Our approach leverages machine learning, human-computer interaction, and industrial engineering to bridge the gap between digital data and physical environments. This AR-RAG system provides factory workers with contextualized, visual information directly overlaid on the CNC machine, enhancing knowledge access and decision-making. In a user study we test the system for usability and efficiency among others. Our results show that we can enhance current factory conditions and contribute to the paradigm shift of industry 5.0 towards a more human centric work environment. The contributions of this paper are (1) the development of a novel AR-RAG framework tailored to virtual factory settings, (2) a comprehensive evaluation of use cases on a real CNC machine, and (3) insights into its potential impact on knowledge management in the manufacturing environment. Our preliminary results could indicate significant improvements in operational efficiency and error reduction. Overall this work integrates transdisciplinary engineering approaches to solve critical manufacturing challenges.
Read the paper
Related studies
- Knowledge Management Perspective of Generative Artificial Intelligence
- Navigating Generative Artificial Intelligence Promises and Perils for Knowledge and Creative Work
- Characterizing the evolving research on enterprise content management
- Large language models and multimodal foundation models for precision oncology
- From Generative AI to Extended Reality: Multidisciplinary Perspectives on the Challenges, Opportunities, and Future of Educational Computing
- Generative Artificial Intelligence: A New Engine for Advancing Environmental Science and Engineering
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.