Search papers, labs, and topics across Lattice.
This paper introduces AgentGuardUtil, a verification harness designed to ensure that in-car LLM agents adhere to strict operating policies by employing a verify-and-revise loop. The innovative runtime policy compiler translates natural-language policies into machine-checkable rules, which are then interpreted by a deterministic obligation engine to enforce compliance in real-time. Key results demonstrate that this approach significantly reduces the risk of policy violations, enhancing the reliability of LLMs in critical vehicular contexts.
LLMs can now be held accountable in real-time, with a verification system that translates natural language policies into executable obligations, drastically reducing the risk of critical errors.
Large Language Models (LLMs) agents deployed in vehicles must satisfy a written operating policy on every turn: a single hallucinated identifier, omitted mandatory side-effect, or premature completion claim fails the task. We present AgentGuardUtil, our entry to CAR-bench Track~1, which treats the AI planer (LLM) as a fallible proposer inside a grounded verify-and-revise loop. Its core novelty is a runtime policy compiler: the natural-language policy shipped with each conversation is compiled, once per policy, into typed machine-checkable rules, a subset of which receive an executable form. A deterministic obligation engine interprets these rules against live tool results and the simulated post-write state of the draft itself, emitting the exact remedial calls with computed arguments rather than natural-language reminders. Around this engine, 25 deterministic gates (identifier provenance, schema and enum validity, gather-before-act, confirmation and future-time protocols) and an LLM critic produce tiered findings that drive a bounded revision loop tuned for the pass k metric.
