Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper reframes embodied AI as an Embodied Turing Machine where the environment state is the tape and the policy is the rules, proposing Code-Only-as-Policy (COAP) to represent and act upon this state entirely through code. COAP offers advantages in explicit state representation, controllable and efficient execution, and extensibility for recursive self-improvement, achieving 70.24% success on 42 bimanual tasks without runtime models. The approach's efficacy hinges on accurate state representation and robust code logic, positioning it as a novel paradigm for embodied tasks and a potential data engine for model-based approaches.
Robots can achieve 70% success on complex bimanual tasks using only code for decision-making, bypassing runtime vision-language models entirely.
Most robot policies keep a model in the control loop: a VLA maps observations to actions, and an Agent Harness, such as Agent-as-Policy or Harness VLA queries a VLM for decision making at run time. We propose a different view: the embodied world is an Embodied Turing Machine, whose tape is the robot and environment state and rules are the policy. If this state can be represented accurately, the decision making can be written entirely in code. We therefore propose Code-Only-as-Policy (COAP): code measures and tracks the robot, environment, and task state from camera images and proprioception, and makes every decision from it. The same code applies across episodes, and different tasks share one library without a VLM or VLA in the loop. Compared with VLAs and Agent Harnesses, we analyze three advantages of COAP: (i) Explicit State: the state can be stored in code; (ii) Execution: code makes decision making controllable, recovers from failures flexibly, and runs fast and cheaply online; (iii) Extensibility: new tasks reuse, inherit, or extend the shared library, so capabilities can accumulate over tasks. These advantages make COAP a suitable medium for recursive self-improvement (RSI): coding agents develop the library in a closed loop, and each change is explicit and controllable. On RoboDojo's 42 bimanual tasks, the resulting library reaches a success rate of 70.24% without a model at test time. The upper bound of COAP lies in how accurately the state is represented for decision making and how robust the code logic is. We thus propose COAP as a new paradigm for embodied tasks; since it applies across episodes, it can also serve as an efficient data engine for VLAs and Agent Harnesses.