Search papers, labs, and topics across Lattice.
This paper introduces Safety Harness Evolution (SHE), a framework designed to enhance the safety of large language model (LLM) agents by allowing their safety harnesses to evolve based on real-world trajectory data. By decomposing the harness into four distinct components鈥擲ystem Prompt, Rule Bank, Safety Memory, and Tool Policy鈥擲HE enables targeted safety improvements and clearer responsibility attribution. Experimental results show that SHE reduces the agent safety risk (ASR) by 3.1 times compared to static methods, while also improving benign utility and demonstrating generalization to new risks across different agent models.
Evolving safety harnesses using trajectory data can reduce agent safety risks by over 3x while enhancing overall utility.
The safety of large language model (LLM) agents depends not only on model weights but also on the agent harness that manages context, memory, tools, permissions, and runtime control. Existing safety mechanisms often treat the harness as a fixed deployment artifact, limiting their ability to evolve with emerging risks. Moreover, coupled functions across harness components obscure safety responsibility attribution, making localized evolution difficult. We propose Safety Harness Evolution (SHE), a framework that learns evolving safe boundaries from rollout trajectories. SHE decomposes the harness into four artifacts with explicit safety responsibilities, including the System Prompt, Rule Bank, Safety Memory, and Tool Policy, defining clear functional boundaries for localized evolution. Based on this decomposition, SHE introduces an attribution-guided evolution loop that converts trajectory failures into structured diagnoses, learns artifact-specific boundary refinements, and selects evolved harnesses through safety-utility validation. Experiments on Agent-SafetyBench demonstrate that SHE effectively enhances safety through harness evolution, achieving a 3.1x ASR reduction compared with static SafeHarness, while also improving benign utility. The evolved harness further generalizes to unseen risks on the held-out AgentHarm benchmark and transfers across agent models without additional evolution.
