Search papers, labs, and topics across Lattice.
This paper introduces HoloAgent-0, a unified framework designed to enhance the deployment of embodied agents in real-world robotic applications by integrating language-based instructions with a structured execution loop. The framework employs a three-layer architecture that includes an Embodied AgentOS, 3D spatial memory, and embodied skills, enabling effective closed-loop execution and coordination among heterogeneous robot models. Evaluations demonstrate HoloAgent-0's capabilities in spatial memory, long-horizon navigation, and various robotic tasks, showcasing its potential to streamline complex robotic operations in dynamic environments.
HoloAgent-0 transforms how robots interpret and act on language instructions, enabling seamless execution of complex tasks in real-world settings.
LLM agents follow a practical execution loop in digital environments: they reason over structured states, invoke tools, inspect feedback, and revise actions. Extending this loop to physical robots is difficult because physical execution is continuous, embodiment-dependent, uncertain, and constrained by safety. Existing embodied-AI systems have advanced manipulation, spatial understanding, navigation, and humanoid control, but these capabilities often remain specialized modules or loosely coupled decision loops. In this work, we introduce HoloAgent-0, a unified embodied agent framework for real-world robot deployment. Embodied AgentOS converts language instructions into executable skill graphs, schedules robot resources, monitors execution, and triggers clarification or re-planning from runtime feedback. HoloAgent-0 organizes heterogeneous robot models and controllers through three coupled layers: Embodied AgentOS for closed-loop execution, 3D spatial memory for physical world grounding, and embodied skills for robot action. We deploy HoloAgent-0 on real hardware and evaluate its spatial memory, long-horizon navigation, and closed-loop execution across motion generation, object search, cross-robot coordination, and mobile manipulation.
