Search papers, labs, and topics across Lattice.
This paper investigates the challenge of non-determinism in human-in-the-loop cyber-physical systems powered by foundation model-based AI agents. They propose using a reactor-model-of-computation (MoC) approach, implemented with the Lingua Franca (LF) framework, to reintroduce determinism. A case study of an agentic driving coach demonstrates the challenges and potential solutions for achieving determinism in these systems.
Taming the unpredictable dance between humans, AI agents, and the physical world might be possible by reintroducing determinism into agentic human-in-the-loop cyber-physical systems.
Foundation models, including large language models (LLMs), are increasingly used for human-in-the-loop (HITL) cyber-physical systems (CPS) because foundation model-based AI agents can potentially interact with both the physical environments and human users. However, the unpredictable behavior of human users and AI agents, in addition to the dynamically changing physical environments, leads to uncontrollable nondeterminism. To address this urgent challenge of enabling agentic AI-powered HITL CPS, we propose a reactor-model-of-computation (MoC)-based approach, realized by the open-source Lingua Franca (LF) framework. We also carry out a concrete case study using the agentic driving coach as an application of HITL CPS. By evaluating the LF-based agentic HITL CPS, we identify practical challenges in reintroducing determinism into such agentic HITL CPS and present pathways to address them.