Search papers, labs, and topics across Lattice.
This paper introduces PI-Hunter, an automated framework designed to proactively expose and localize prompt injection vulnerabilities in large language model (LLM) agents. By constructing realistic, source-aware test cases and employing feedback-driven exploration, PI-Hunter effectively reveals latent malicious instructions that may be embedded in external environments. Experimental results show that PI-Hunter significantly enhances vulnerability exposure and attack-surface coverage compared to existing red-teaming methods, while maintaining effectiveness against current defenses.
PI-Hunter uncovers hidden prompt injection vulnerabilities in LLM agents that traditional defenses miss, revealing a critical gap in current security practices.
Large Language Models (LLMs) are rapidly evolving into agentic systems that interact with external tools and environments, introducing new security risks such as indirect prompt injection attacks through untrusted external sources. Existing defenses mainly focus on blocking malicious content at inference time, and current red-teaming methods primarily optimize attack success. As a result, developers have limited visibility into how latent prompt injections emerge and propagate through agents. We propose PI-Hunter, an automated agentic auditing framework for proactive vulnerability exposure in LLM agents. PI-Hunter constructs realistic source-aware test cases and iteratively evolves them through feedback-driven exploration to induce agents to retrieve and reveal latent malicious instructions embedded within external environments. Extensive experiments across multiple benchmarks, agent architectures, attacks, and defenses demonstrate that PI-Hunter substantially improves vulnerability exposure and attack-surface coverage over strong automated red-teaming baselines, while remaining effective under existing prompt injection defenses.
Google Research