Search papers, labs, and topics across Lattice.
This paper introduces a modular framework for robotic surface-interaction tasks that decouples geometric motion planning from execution-level expertise by learning a vocabulary of interpretable motor rules. A multimodal neural network is trained to infer parameters for these rules, such as velocity scaling and orientation offsets, from kinematic trajectory data and CAD model geometry. Experiments on simulated L-shaped and window-shaped objects demonstrate successful extraction of velocity and orientation rules across different topologies, improving transferability.
Robots can now learn expert human-like motor skills for surface tasks by simply observing demonstrations on different geometries, unlocking more adaptable and efficient automation.
Robotic surface-interaction tasks, such as spray painting or welding, require both accurate geometric planning and precise motion execution. While modern motion planners generate valid geometric paths, they often lack the expert motor patterns observed in human operators. Conversely, learning from demonstration often tightly couples task execution to the specific training geometry, limiting transferability. We propose a modular framework that decouples geometric motion planning from execution-level expertise. Expert behavior is represented as a vocabulary of interpretable, atomic motor rules, such as velocity scaling and orientation offsets, that systematically modify a geometrically planned reference path. We train a multimodal neural network to infer rule parameters jointly from kinematic trajectory data and CAD model geometry. We evaluate our approach through dynamic simulation on L-shaped and window-shaped objects, demonstrating on simulated data that the model successfully extracts velocity and orientation rules across both topologies.