Search papers, labs, and topics across Lattice.
The paper introduces DexEvolve, a generate-and-refine pipeline for synthesizing diverse and robust dexterous grasps by using a high-fidelity simulator (Isaac Sim) as an optimization environment. They initialize an evolutionary search with analytically generated grasps and refine them using an asynchronous, gradient-free evolutionary algorithm to improve stability and diversity. The refined grasp distribution is then distilled into a diffusion model for real-world deployment, demonstrating the importance of diversity for both training and deployment.
Evolutionary optimization in high-fidelity simulators unlocks a 6x boost in stable, diverse dexterous grasps compared to traditional analytical methods.
Dexterous grasping is fundamental to robotics, yet data-driven grasp prediction heavily relies on large, diverse datasets that are costly to generate and typically limited to a narrow set of gripper morphologies. Analytical grasp synthesis can be used to scale data collection, but necessary simplifying assumptions often yield physically infeasible grasps that need to be filtered in high-fidelity simulators, significantly reducing the total number of grasps and their diversity. We propose a scalable generate-and-refine pipeline for synthesizing large-scale, diverse, and physically feasible grasps. Instead of using high-fidelity simulators solely for verification and filtering, we leverage them as an optimization stage that continuously improves grasp quality without discarding precomputed candidates. More specifically, we initialize an evolutionary search with a seed set of analytically generated, potentially suboptimal grasps. We then refine these proposals directly in a high-fidelity simulator (Isaac Sim) using an asynchronous, gradient-free evolutionary algorithm, improving stability while maintaining diversity. In addition, this refinement stage can be guided toward human preferences and/or domain-specific quality metrics without requiring a differentiable objective. We further distill the refined grasp distribution into a diffusion model for robust real-world deployment, and highlight the role of diversity for both effective training and during deployment. Experiments on a newly introduced Handles dataset and a DexGraspNet subset demonstrate that our approach achieves over 120 distinct stable grasps per object (a 1.7-6x improvement over unrefined analytical methods) while outperforming diffusion-based alternatives by 46-60\% in unique grasp coverage.
