Search papers, labs, and topics across Lattice.
This paper introduces a novel approach called control-data flow separation to optimize prompts in multi-agent LLM systems by decoupling execution-critical protocols from task-relevant content. By representing execution protocols as structured program objects while allowing task-relevant language to remain flexible, the method prevents prompt edits from inadvertently disrupting the underlying agent pipeline. Empirical results demonstrate that this framework achieves 100% protocol validity while enhancing task performance across various applications, including synthetic reasoning and collaborative workflows.
By separating control from data flow, this approach ensures that prompt optimization enhances performance without risking protocol integrity.
Prompt optimization can improve multi-agent LLM systems, but the prompts being optimized often serve two entangled roles: generating task-relevant content and specifying execution-critical protocols, such as message routing, output formatting, and termination signals, on which the underlying code relies. As a result, a prompt edit intended to improve content generation can inadvertently corrupt the protocol and cause the entire agent pipeline to fail. Our key observation is that these two roles have different representations: execution protocols are typically structured, while task-relevant content is usually expressed in unstructured language. Based on this, we propose control-data flow separation, where execution-critical control is represented as typed, validated program objects, while task-relevant language remains the optimizable data flow for agent communication. This design allows optimizers to improve multi-agent behavior without exposing the routing or formatting interface to prompt drift. Across synthetic reasoning, collaborative review generation, and insurance rating workflows, our framework empirically achieves 100% eventual protocol validity while consistently improving task performance.
