Search papers, labs, and topics across Lattice.
APT-Agent, a fully automated LLM-driven penetration testing framework, was developed to address the challenges of hallucination and limited contextual memory in existing LLM-based approaches. It incorporates a hybrid rectification module to correct hallucinated commands and a command-specific memory architecture to maintain context across multi-step attacks. Evaluated on Metasploitable 2, APT-Agent achieved an 84.29% exploitation success rate, significantly outperforming Script Kiddie (48.57%) and PentestGPT (18.57%).
LLMs can now autonomously exploit over 80% of vulnerabilities in standard penetration testing environments, thanks to a novel architecture that mitigates hallucinations and improves long-term memory.
Penetration testing is essential to securing modern web infrastructures, yet traditional manual methods struggle to keep pace with their scale and complexity. Large Language Models (LLMs) offer new opportunities for automating these tasks, but existing approaches face two persistent challenges: hallucination of technical entities and insufficient long-term contextual memory. To address these issues, we present APT-Agent, a fully automated LLM-driven penetration testing framework that systematically orchestrates reconnaissance, exploitation, and exfiltration. APT-Agent introduces a hybrid rectification module to recover hallucinated commands and a command-specific memory architecture to preserve operational context across multi-step attack sequences. We evaluate our APT-Agent on Metasploitable 2 against seven vulnerable services spanning web, database, and network protocols. APT-Agent achieves an 84.29% end-to-end exploitation success rate, compared to 48.57% (Script Kiddie) and 18.57% (PentestGPT) under matched conditions. By reducing cognitive burden and minimizing reliance on human intervention, APT-Agent represents a step toward scalable, reliable, and cognitively efficient automation for penetration testing.
