Search papers, labs, and topics across Lattice.
The paper introduces EMERGE-Policy, a graph-structured framework that enables a robot to function effectively without relying on a single policy by coordinating specialized components for perception, reasoning, and memory. This approach allows for a division of labor among role-specific Sub Agents, which handle distinct tasks while sharing relevant information with a Main Agent, ultimately enhancing the robot's decision-making capabilities. The results demonstrate that EMERGE-Policy achieves superior performance on public benchmarks and in real-world robot experiments, showcasing the potential for improved policy robustness through collaborative agent interactions.
EMERGE-Policy reveals that a robot's intelligence can thrive through a collaborative network of specialized agents rather than a monolithic policy.
A robot's effective ``mind'' need not reside in a single policy. It can emerge when specialized components perceive, reason, predict, act, verify, and remember within a shared orchestration process. EMERGE-Policy turns this perspective into a graph-structured agentic framework that coordinates both capability invocation and information exchange. A Main Agent retains task-level state within an active context window, while role-specific Sub Agents process perception, execution monitoring, verification, and memory consolidation in isolated contexts and return structured, task-relevant evidence. Role-specific contexts control information load by exposing only decision-relevant evidence to the Main Agent, while the functional Skill interface composes heterogeneous backends as Operational, Imagination, and Evaluation Skills. Criterion-grounded verification, textual failure diagnosis, and Branch Stack recovery provide localized correction, with token-aware external memory preserving task-relevant state. Together, their closed-loop interaction realizes the system-level policy captured by the name EMERGE-Policy. Without additional fine-tuning, we achieved outstanding performance on several public benchmark that have had a wide-reaching impact, and conducted a series of real robot experiments. These system-level results suggest that through the division of different functional sub-tasks among multiple agents and their concurrent collaboration, as well as the technical paradigm where the model is regarded as a skill and called within the framework, EMERGE-Policy can extend the robust robot policies beyond isolated runs.
Tsinghua AI