Search papers, labs, and topics across Lattice.
This paper introduces POLICYGUARD, a dialogue-grounded verifier designed to enhance policy adherence in LLM agents by incorporating full conversation context, self-reasoning over policies, and conversation-specific remediation. The authors argue that traditional safeguarding methods are insufficient for the complexities of real-world interactions, which require a nuanced understanding of dialogue dynamics. Experimental results on the tau^2-BENCH airline dataset demonstrate that POLICYGUARD significantly improves policy-violation recall while reducing unnecessary blocks compared to existing argument-level safeguards.
POLICYGUARD boosts policy adherence in LLM agents by leveraging dialogue context and self-reasoning, achieving a 12% increase in compliance recall while halving the blocking rate of traditional methods.
LLM agents handle user requests on behalf of organizations through tool calls and must follow the company policies stated in their system prompts. Prior work approaches this as a safeguarding problem -- external checks that block non-compliant agent actions. We argue that policy adherence is a broader problem: real workflows unfold across many turns, require explicit user confirmation and prerequisite reads, and hinge on the content of the dialogue rather than on any single argument value. Meeting this bar requires (i) full conversation context, (ii) self-reasoning over the policy and the current dialogue, and (iii) conversation-specific remediation that guides the agent's next turn -- three capabilities that prior safeguard work has often underestimated. We introduce POLICYGUARD, a sub-agent verifier that shares the agent's view of the dialogue, reasons over the policy in context, and provides actionable feedback for the agent's next turn. On tau^2-BENCH airline across three vendors (GPT-5.4, Claude Sonnet 4.6, Gemini 2.5 Pro) with four trials per setting, POLICYGUARD improves PASS4 by +12.0 / +6.0 / +12.0 pp. Per-call analyses show POLICYGUARD achieves higher policy-violation recall while blocking roughly half as often as argument-level guards.
