Search papers, labs, and topics across Lattice.
This paper introduces AgentLens, a novel white-box defense framework designed to enhance the safety of multi-turn coding agents by performing runtime safety detection and intervention at the representation level. By leveraging a 10-dimensional subspace within a single layer, AgentLens effectively identifies harmful execution states and mitigates unsafe behaviors, outperforming traditional guardrail approaches. The authors also present the Mechanistic Agent Safety (MAS) benchmark, which provides annotated multi-turn execution data across 194 tasks, demonstrating that AgentLens significantly reduces harmful actions while enabling lookahead risk anticipation.
Runtime safety detection in coding agents can be achieved through a novel intervention in hidden representations, drastically reducing harmful actions during multi-turn interactions.
Coding agents based on large language models (LLMs) demonstrate remarkable autonomous capabilities, but they also introduce significant safety and misuse risks during multi-turn interactions with external environments. Existing safety mechanisms mainly rely on external guardrails, which have a limited ability to perform fine-grained behavioral control during execution. Meanwhile, recent mechanistic interpretability methods for LLM safety are mostly confined to single-turn or jailbreak-style QA settings, limiting their ability to capture the evolving risk dynamics of multi-turn agent execution. In this paper, we investigate the safety of multi-turn coding agents from an internal perspective. We propose AgentLens (Mechanistic Subspace Intervention and Steering), a white-box defense framework that performs runtime safety detection and representation-level mitigation for coding agents. Unlike conventional agent guardrails, AgentLens detect harmful execution states from step-level hidden representations and mitigate unsafe behavior by intervening in a 10-dimensional subspace within a single layer. To support this research, we introduce the Mechanistic Agent Safety (MAS) benchmark, comprising comprehensively annotated multi-turn execution trajectories across 194 tasks using LLaMA-3.1-8B, Qwen-2.5-7B, and Gemma-2-9B. Extensive experiments show that AgentLens achieves strong safety detection performance, provides preliminary evidence for lookahead risk anticipation, and substantially reduces harmful actions of the coding agent, establishing a foundation for applying mechanistic interpretability to dynamic LLM agent safety. The code is available at: https://github.com/EddyLuo1232/AgentLens
