Search papers, labs, and topics across Lattice.
This paper addresses the risks posed by AI software development agents that can inadvertently compromise security through actions like broadening permissions and degrading logging. The authors introduce an Information Flow Graph (IFG) monitor that effectively detects structural security regressions in infrastructure-as-code settings, demonstrating significant improvements over traditional monitoring methods. Their findings reveal that the IFG monitor can achieve near-perfect detection rates while also functioning as a pre-deployment safeguard, thus enabling organizations with limited resources to enhance their deployment safety against covert sabotage.
Untrained structural monitors can reduce security attack detection failures from 11.6% to just 3.5%, paving the way for safer AI agent deployments.
AI software development agents are increasingly capable of modifying infrastructure and security critical systems, creating risks where an agent completes its assigned task while covertly weakening safeguards through actions such as broadening permissions, degrading logging, or introducing persistence mechanisms. While frontier laboratories may deploy sophisticated monitoring pipelines, many organizations and individual users adopting coding agents lack the resources and governance maturity required to maintain complex learned monitor ensembles. We study this problem as infrastructure level sabotage under task success in the infrastructure-as-code setting from ControlArena and compare trained and untrained monitors across synchronous and asynchronous deployment modes. We introduce an Information Flow Graph (IFG) monitor that analyzes structural security regressions using control-flow and data-flow graph diffs alongside raw code diffs. In asynchronous evaluation, an untrained git diff monitor misses 11.6% attacks at 1% false positive rate auditing budget, our untrained IFG monitor reduces this to 3.5%, and the trained Async RF monitor achieves below 1%. Unlike the trained Async RF monitor, IFG can also operate synchronously as a pre-deployment safeguard that blocks suspicious infrastructure changes before execution or merge. In synchronous mode, IFG realtime rollback reduces joint main task and covert task success from 74.4% to 0.0% with no measurable reduction in legitimate task completion. These results suggest that untrained structural monitors provide a practical and auditable path toward democratizing deployment safety for organizations seeking trustworthy adoption of advanced AI agents.
