Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
The authors present a framework for robot tool design from scratch that jointly optimizes discrete tool topology, continuous shape geometry, and execution actions directly from desired physical task outcomes. To overcome the limitations of prior methods that rely on human-prescribed structural templates, their hierarchical optimization framework (HOT) pairs an upper-level discrete structure search with lower-level physical simulation that returns behavioral milestone feedback to steer the search. Evaluated across four distinct physical manipulation tasks, the method effectively traverses combinatorial spaces of up to 56 million topologies, synthesizing functional designs that successfully transfer zero-shot to real-world robotic execution via 3D printing.
Instead of adapting pre-existing human templates, robots can now autonomously invent novel physical tools—co-optimizing structure, geometric refinement, and motor trajectories entirely from scratch out of combinatorial spaces spanning tens of millions of designs.
The ability to design a tool for a task marks a level of intelligence beyond merely understanding, selecting, or using one. Existing methods for robotic tool design typically optimize a tool's continuous shape and action within a structure that is prescribed or generated beforehand, so the structure itself stays outside the physical optimization loop. We study task-driven tool design from scratch, where tool structure, shape, and action are all derived from the desired physical outcome. Here we show that the three elements can be designed jointly by HOT, a hierarchical optimization whose upper level searches over discrete tool structures with BASS, while lower-level physical optimization evaluates their task behavior and returns milestone progress as behavioral evidence for the search, ultimately providing jointly optimized shape and action. On four tool-use tasks with distinct physical functions, HOT discovers functional structures after evaluating only a small fraction of search spaces containing up to 56 million structures, and the subsequent refinement of their geometry lowers the task loss on all tasks while preserving success, through deformations that are functionally interpretable. Once 3D printed, the tools accomplish all tasks on a real robot with the actions found in simulation. Designing tools from required physical effects, rather than a catalog of known tools, is a step toward the open-ended tool making seen in humans and animals.