Search papers, labs, and topics across Lattice.
This paper introduces GaP, a multi-agent coding harness that leverages directed computation graphs to enhance the performance of robots in variational automation tasks, which are characterized by significant variability in object geometry and pose. By integrating perception, planning, and control nodes from a Modular Open Robot Skill Library (MORSL), GaP creates an internal simulation environment that allows for parallel rehearsal and iterative refinement of task execution strategies. The results demonstrate that GaP significantly outperforms baseline methods across eight new open VA task benchmarks, both in simulation and real-world scenarios, indicating its potential for reliable robotic applications in dynamic environments.
GaP outperforms traditional methods in variational automation tasks by leveraging directed computation graphs for real-time adaptability and improved success rates.
For robots to work reliably in commercial and industrial applications, can recent advances in agentic coding systems combine interpretable robot programming with the open-world adaptability of model-free policies? We focus on"Variational Automation"(VA), a class of tasks that have larger variations in object geometry and pose than fixed automation. Model-free policies often struggle to close the reliability gap for VA tasks, which must be executed persistently and reliably in commercial and industrial applications. Motivated by prior work on Task and Motion Planning (TAMP) and the Robot Operating System (ROS), we introduce Graph-as-Policy (GaP), a multi-agent coding harness that generates directed computation graphs with perception, planning, and control nodes from a Modular Open Robot Skill Library (MORSL). GaP then generates an internal simulation environment to rehearse task instances with different graphs in parallel to iteratively refine the graph structure and parameters to improve success rates and throughput. Evaluation with 8 new open VA task benchmarks, 4 in-simulation and 4 in real-world, suggests that GaP can achieve success rates that significantly outperform baselines. Details, code, and data can be found online: https://graph-robots.github.io/gap
BAIR
CMU ML
NVIDIA