Search papers, labs, and topics across Lattice.
This paper introduces Code-Augur, a novel framework for agentic vulnerability detection that utilizes a security-specification-first approach to enhance the transparency and reliability of autonomous LLM audits. By explicitly exposing the tacit assumptions of the agent as security specifications and refining them through runtime falsification, Code-Augur not only uncovers critical vulnerabilities that have remained hidden for years but also aligns the agent's understanding of code intent with actual behavior. The results demonstrate that Code-Augur outperforms existing state-of-the-art agents, identifying 22 new vulnerabilities in key open-source projects while leveraging widely available LLMs.
Code-Augur reveals hidden vulnerabilities in software by transforming agentic assumptions into explicit security specifications, leading to unprecedented detection rates.
The advent of agentic vulnerability detection is already becoming a watershed moment for software security. Audits conducted entirely by autonomous LLM agents are uncovering critical vulnerabilities in fundamental software underpinning digital society. Many of these vulnerabilities remained masked for years, surfacing only now with AI agents. Yet the reasoning behind these discoveries remains alarmingly opaque and unvalidated. What assumptions did the agent make about a function's inputs when it deemed that function to be secure? Failures in reasoning and incorrect assumptions can lead to missed vulnerabilities and reduce trust in agentic analysis. We propose a security-specification-first paradigm that (1) exposes the agent's tacit assumptions explicitly as security specifications and (2) continuously refines those specifications via runtime falsification. We realize our approach in Code-Augur, a novel harness for agentic vulnerability detection. Given a codebase, Code-Augur analyzes each component of the system for vulnerable code. When it deems a component to be secure, it commits the local invariants behind that judgment as in-source assertions. In parallel, Code-Augur leverages a guided fuzzer to attempt to falsify those assumptions. When the fuzzer triggers an assertion, this either reveals a genuine vulnerability or a flawed specification to refine. In both cases, this process grounds the agent's understanding, aligning its view of code intent with how the code actually behaves. On real-world subjects, Code-Augur effectively leverages security specifications to detect more vulnerabilities than other state-of-the-art agents. Additionally, Code-Augur found 22 new vulnerabilities in key open-source projects. Compared to curated specialized models like Claude Mythos, Code-Augur offers effective agentic vulnerability detection built on widely available LLMs like Sonnet and DeepSeek.
