Search papers, labs, and topics across Lattice.
This paper introduces DynamicManip, a novel approach to dynamic manipulation that synthesizes diverse dynamic scenarios from a single static demonstration, addressing the challenges of data efficiency and real-time execution in robotic tasks. By employing a static-to-dynamic augmentation pipeline and a dynamic-aware adaptive policy, the method enables robots to adjust their inference frequency based on task dynamics, leading to improved responsiveness. Experimental results show that DynamicManip enhances data efficiency and performance, achieving an 18.4 percentage point increase in success rates and a 32.9% reduction in policy-query latency compared to existing methods.
Robots can now learn to manipulate dynamic environments effectively from just one static demonstration, drastically improving performance and efficiency.
Dynamic manipulation is a critical capability for robots operating in complex and dynamic environments, where robots must interact with objects that are moving or require rapid adjustments. However, learning models for dynamic manipulation tasks face two major challenges: (1) the combinatorial complexity of dynamic scenarios leads to substantial data requirements, and (2) rapid variations in dynamics require real-time and accurate policy execution. In this paper, we propose DynamicManip to address these challenges through an efficient data augmentation pipeline and a low-latency imitation policy. We first propose a static-to-dynamic augmentation pipeline that synthesizes diverse dynamic manipulation demonstrations from a single static demonstration. Second, we introduce a dynamic-aware adaptive policy that adjusts its inference frequency according to task dynamics, enabling responsive and effective dynamic manipulation. Third, we build a dynamic manipulation benchmark, which includes diverse dynamic tasks with an automatic evaluation system for scalable and consistent assessment. Extensive experiments in both simulation and the real world demonstrate that DynamicManip not only provides significant improvements in data efficiency but also achieves better performance in dynamic manipulation tasks, with a mean success rate 18.4 percentage points higher and policy-query latency 32.9% lower.