Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates the evasion of steganographic payloads embedded in large language models (LLMs) and demonstrates that existing detection methods, such as linear probes, can be systematically circumvented. By adversarially fine-tuning steganographic trojans across multiple LLMs, the authors achieve a balance where secret recovery remains high (58-79%) while detection evasion is maintained, resulting in minimal performance degradation (1-8%). The study further introduces a targeted data-level intervention that restores detectability by constraining the model's residual degrees of freedom, thereby exposing hidden payloads that would otherwise evade detection.
Evasive steganographic payloads in LLMs can retain high recoverability while eluding detection, but targeted data interventions can restore visibility to these hidden secrets.
Large language models can be fine-tuned to encode prompt-borne secrets into fluent, seemingly benign outputs. This creates a steganographic exfiltration risk that is difficult to detect with output-level steganalysis. Recent work proposes mechanistic detection using linear probes that recover the secret from internal activations. We show that this defense can be systematically evaded, but that detectability can be recovered through a targeted data-level intervention. First, we extend the detection setup to include a non-linear MLP probe. We then adversarially fine-tune steganographic trojans across five base models: Qwen3-8B, Llama-3.1-8B, Ministral-8B, Qwen3-14B, and Phi-4-14B. The resulting models retain $58$--$79\%$ exact-match secret recovery while evading both ridge and held-out MLP probes, with $1$--$8\%$ average capability degradation across six benchmarks. We then give an information-theoretic characterization of this evasion. Successful evasion preserves recoverability while reducing low-order extractability of the secret from the content-aligned representation, forcing the payload into synergistic interaction with residual degrees of freedom. This motivates a recontextualization dataset that restricts these residual degrees of freedom. On this distribution, both ridge and MLP detectability are restored across all five evasive trojans. Overall, our findings show that activation-based steganography detection is vulnerable to adaptive evasion, but also that theory-guided evaluation distributions can expose otherwise hidden payloads.