Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
HumanoidToolBench is introduced as an 18-task benchmark to evaluate humanoid robots' ability to select and use tools for tasks requiring manipulation and locomotion, addressing a gap in existing benchmarks. Evaluation across simulation and real-world robots reveals significant performance disparities between tool selection and successful task completion, highlighting challenges in integrating these capabilities. The benchmark, comprising three scenarios, three execution levels, and two tool-set modes, along with the ToolBook dataset, provides a comprehensive evaluation framework for advancing humanoid tool use.
Humanoid robots struggle to bridge the gap between selecting the right tool and executing complex tasks, with current policies showing significant performance degradation on unseen tools and unrelated instructions.
As robotic hardware and learning methods advance, humanoids need tools to perform tasks beyond their inherent physical limits. Successful tool use requires selecting a suitable tool and coordinating manipulation and, when needed, locomotion to complete the task. Existing benchmarks do not jointly evaluate these capabilities on a humanoid. We introduce HumanoidToolBench, an 18-task benchmark spanning three scenarios, three execution levels, and two tool-set modes, together with ToolBook, a dataset of 3.1k demonstrations collected in simulation and on a real Unitree G1. Evaluation of seven policies in simulation and three on the real robot reveals substantial gaps between selecting a suitable tool and completing the task. Focused GR00T N1.7 probes show reduced selection accuracy on unseen tools and continued task execution under unrelated instructions. Code and data are available at https://snu-pi.github.io/HumanoidToolBench/.