Search papers, labs, and topics across Lattice.
This paper addresses the challenge of generating large-scale, high-quality datasets for training generalist policies in bimanual dexterous manipulation by introducing a reinforcement learning (RL)-based data generation pipeline. By integrating generalizable reward design, effective domain randomization, and language-conditioned task annotations, the authors create diverse synthetic datasets that enhance the training of multi-task policies. The results demonstrate significant improvements in generalization across multiple manipulation tasks, highlighting the effectiveness of the proposed approach in overcoming limitations of existing methods.
Synthetic data generation via RL not only scales but also enhances generalization in bimanual dexterous manipulation by leveraging language-conditioned task annotations.
A key bottleneck in training generalist policies for bimanual dexterous manipulation is the lack of large-scale, high-quality datasets. Synthetic data generation in simulation provides a scalable alternative to human video demonstrations by overcoming challenges such as morphology mismatch, missing physical interactions, and the generation of robot actions. However, existing approaches based on human teleoperation offer limited task diversity, as object-centric trajectory matching often neglects the feasibility of robot execution. Reinforcement learning (RL) enables broader scalability but is often constrained by handcrafted, task-specific rewards. In this work, we propose a systematic RL-based data generation pipeline that integrates generalizable reward design, effective domain randomization, and language-conditioned task annotations. This pipeline synthesizes diverse, high-quality datasets for dexterous bimanual manipulation and enables training of language-conditioned multi-task policies. Our experiments show that the generated data significantly improves generalization across three representative manipulation tasks.
