Search papers, labs, and topics across Lattice.
This paper introduces CAPO (Constraint-Aware Prompt Optimization), a primal-dual method designed to optimize system prompts for large language model (LLM) agents under specific operational constraints such as tool use and safety compliance. By leveraging pool-based rewrites and adaptive constraint weighting, CAPO enhances task performance while ensuring that prompts meet strict operational requirements. The method not only excels in agentic benchmarks but also generalizes effectively to assistant-style evaluations, demonstrating its versatility and robustness across various domains.
CAPO enables LLMs to meet stringent operational constraints without sacrificing task performance, achieving feasible prompts in every evaluated domain.
Large language models (LLMs) are increasingly deployed as agents that rely on system prompts to use tools and complete tasks. Such deployments impose distinct operational requirements, including appropriate tool use, concise prompts and solution paths, and compliance with safety and formatting policies. For many practitioners, however, assembling domain-specific supervised data to post-train models to meet these requirements is infeasible. We introduce CAPO (Constraint-Aware Prompt Optimization), a primal-dual method that combines pool-based rewrites with adaptive constraint weighting to optimize system prompts under explicit operational constraints. Across agentic benchmarks, CAPO more reliably reaches empirically feasible operating points while improving task performance. CAPO also generalizes beyond agentic settings, achieving strong results on assistant-style evaluations with output-format and safety/privacy constraints. We further introduce DCAPO (Dynamically Trained CAPO), which trains a feedback- and dual-conditioned rewriter with pool-based GRPO while keeping the task agent frozen. Across task agents of different sizes, DCAPO produces a feasible prompt in every evaluated domain and matches or improves the task accuracy achieved by the evaluated baselines. A surrogate analysis characterizes how finite-pool and discrete-rewrite errors enter the inexact primal-dual procedure.
