Large Language Models in Sensor-Driven Control Systems: Architectures, Challenges, and Opportunities
Abstract
Large language models (LLMs) are increasingly being explored for integration into sensor-driven control systems across robotics, industrial automation, energy infrastructure, healthcare, smart environments, and other sensor-rich domains. This review synthesizes emerging research from the perspective of sensor-driven control systems, defined as systems in which sensing is substantively linked to monitoring, estimation, supervision, planning, decision-making, or actuation. Rather than treating LLMs as generic intelligent agents, the review examines their position within the sensing-decision-control chain and their interaction with state representations, supervisory logic, human operators, external tools, and classical control components. The paper develops a functional taxonomy of LLM roles based on proximity to actuation, grounding requirements, and deployment risk. This taxonomy reveals a clear maturity gradient: interpretive, supervisory, diagnostic, and engineering-support roles are currently the most credible and deployable, whereas runtime control participation remains the least mature and highest-risk form of integration. The analysis further shows that reliable implementations are predominantly hybrid. In such architectures, LLMs function as semantic and orchestration layers that augment, rather than replace, classical sensing, estimation, planning, and control. Key integration patterns include sensor-to-semantics pipelines, retrieval-augmented generation, tool use,…
Read the paper
Related studies
- Knowledge Management Perspective of Generative Artificial Intelligence
- Navigating Generative Artificial Intelligence Promises and Perils for Knowledge and Creative Work
- Characterizing the evolving research on enterprise content management
- Large language models and multimodal foundation models for precision oncology
- From Generative AI to Extended Reality: Multidisciplinary Perspectives on the Challenges, Opportunities, and Future of Educational Computing
- Generative Artificial Intelligence: A New Engine for Advancing Environmental Science and Engineering
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.