Search papers, labs, and topics across Lattice.
This paper introduces a method for generalizing motion policies from expert demonstrations to new robotic tasks by combining isolated demonstrations within a shared workspace. The core idea is to represent spatial components of learned motion primitives as vertices in a Gaussian Graph, enabling the bridging of continuous control with discrete graph search. Two frameworks, Stitching and Chaining, are proposed to leverage this graph for constructing time-invariant and sequence-based dynamical systems respectively, achieving generalization to unseen tasks while retaining convergence guarantees.
Unlock zero-shot robotic task generalization by stitching together motion primitives as nodes in a graph, enabling robots to adapt to new scenarios without retraining.
Learning motion policies from expert demonstrations is an essential paradigm in modern robotics. While end-to-end models aim for broad generalization, they require large datasets and computationally heavy inference. Conversely, learning dynamical systems (DS) provides fast, reactive, and provably stable control from very few demonstrations. However, existing DS learning methods typically model isolated tasks and struggle to reuse demonstrations for novel behaviors. In this work, we formalize the problem of combining isolated demonstrations within a shared workspace to enable generalization to unseen tasks. The Gaussian Graph is introduced, which reinterprets spatial components of learned motion primitives as discrete vertices with connections to one another. This formulation allows us to bridge continuous control with discrete graph search. We propose two frameworks leveraging this graph: Stitching, for constructing time-invariant DSs, and Chaining, giving a sequence-based DS for complex motions while retaining convergence guarantees. Simulations and real-robot experiments show that these methods successfully generalize to new tasks where baseline methods fail.
