Search papers, labs, and topics across Lattice.
This paper introduces the Embodied Task Agent (ETA), a novel framework designed to enhance the capabilities of robots in unfamiliar environments by enabling them to learn from experience and maintain control during long interactions. ETA operates through a structured loop involving a Planner, Interface, and World, allowing the robot to adapt its actions based on outcomes and leverage past interactions for improved performance. The release of OpenETA as an open-source implementation provides a versatile platform with replaceable components and common interfaces, facilitating both simulation and real-world applications.
Robots can now learn from their experiences and adapt in real-time, paving the way for a new era of general-purpose robotic agents.
When will robots have their ChatGPT moment? Such a breakthrough requires a general-purpose robot that can handle unfamiliar tasks in unfamiliar environments, remain controllable over long interactions, and learn from experience. Today's embodied systems largely follow an end-to-end observation-to-action path. Despite rapid progress, they remain far from this goal: their generalization depends heavily on the coverage of robot training data, while long task execution remains difficult to control and inspect. To realize this goal, we introduce the Embodied Task Agent (ETA), a new paradigm for extending digital agents into the physical world, and release OpenETA as its open-source implementation. ETA centers the robot around a Planner that chooses one Tool call at a time, an Interface that controls execution, and a World that returns the result and a fresh observation. This loop allows the agent to verify outcomes, adapt its plan, and turn successful and failed interactions into reusable experience. OpenETA provides replaceable Planners, composable Tools and Skills, auditable memory, replayable trajectories, and common interfaces for simulation and real robots. For Codex, OpenETA can operate as a lightweight plugin that exposes only observe, mark_point, and move_to.
