Search papers, labs, and topics across Lattice.
This paper introduces PromptGraph, a novel approach to prompt sanitization that addresses the privacy risks associated with Large Language Model (LLM) inference by modeling the contextual relationships between spans of text. By representing prompts as attributed graphs, where nodes reflect span-level privacy scores and edges denote contextual dependencies, the method effectively balances privacy preservation with the retention of utility. Experimental results demonstrate that PromptGraph significantly outperforms existing prompt-privacy baselines in achieving this balance, highlighting its potential for safer LLM applications.
PromptGraph reveals that modeling contextual relationships between text spans can dramatically enhance privacy preservation in LLM inference without sacrificing utility.
Large Language Model (LLM) services introduce a fundamental privacy challenge. Sensitive information may be inferred not only from explicit identifiers, such as names or phone numbers, but also from contextual associations among otherwise innocuous spans. Existing sanitizers typically assign privacy or utility signals to individual spans without explicitly modeling pairwise relationships among them. In this paper, we propose PromptGraph, a graph-guided prompt-sanitization approach for privacy-preserving LLM inference. PromptGraph estimates privacy leakage at the span level and utility-relevant contextual dependencies between pairs of spans. It represents each prompt as an attributed graph, in which nodes carry span-level privacy scores and edges encode contextual dependencies needed to preserve utility. The sanitization objective selects a protected span set that maximizes privacy gain while penalizing the loss of contextual dependencies. This formulation explicitly balances privacy and utility when contextual evidence is hidden. Protected spans are sanitized locally, and returned placeholders are restored only after passing local consistency checks. We conduct extensive experiments showing that PromptGraph achieves a more favorable balance between privacy and utility than prompt-privacy baselines.
