Search papers, labs, and topics across Lattice.
This paper identifies and formalizes a failure mode in prompt-composed agentic systems known as compositional behavioral leakage (CBL), where changes to one prompt module inadvertently affect the behavior of others due to architectural non-isolation in transformer models. Through a rigorous evaluation of a deployed job-evaluation agent, the authors demonstrate that only perturbations in the content of non-focal modules lead to measurable behavioral shifts, with a significant effect size (Cohen's d = 0.63). The findings highlight the critical need for cross-module interference measurement in the evaluation of prompt-composed agents, as this leakage can accumulate unnoticed across numerous decisions made by the system.
Editing one prompt module can unintentionally alter the behavior of others, revealing a hidden layer of complexity in agentic systems that could undermine their reliability.
Practitioners of prompt-composed agentic systems report a recurring failure mode: editing one prompt module silently shifts the behavior of others despite no shared variable or executable dependency. We formalize this as compositional behavioral leakage (CBL): interference between modules sharing a context window. CBL is enabled by architectural non-isolation: transformer self-attention provides no formal boundary between concatenated modules. We probe CBL on a deployed job-evaluation agent (Claude Sonnet 4.6, 144 trials) through a reusable three-channel protocol that perturbs non-focal modules along volume, content, and form. Only the content channel produces a detectable paired effect (Cohen's d = 0.63, bootstrap 95% CI excluding zero); no recommendation flipped -- a sub-threshold regime invisible to standard QA but compounding across the thousands of decisions a deployed agent makes. CBL is orthogonal to known agent-failure axes (adversarial injection, cognitive degradation, multi-agent fault propagation, privacy leakage). We contribute an operational definition, a reusable protocol, a falsifiable prediction set, and a system-class characterization, establishing cross-module interference measurement as a requirement for prompt-composed agent evaluation.
