Search papers, labs, and topics across Lattice.
This paper introduces an innovative framework for dexterous grasp generation that integrates arm-related constraints using pretrained arm-agnostic models, addressing the limitations of traditional hand-centric approaches. By formulating the problem as a joint optimization of hand pose and arm configuration, the authors derive closed-form gradients that facilitate efficient grasp generation in complex environments. Comprehensive evaluations show that their method significantly increases the probability of generating feasible grasps in constrained settings, proving its effectiveness for real-world applications involving arm-environment interactions.
Guiding dexterous grasp generation with arm-aware constraints boosts feasibility in complex environments, outperforming traditional methods reliant on hand-centric models.
Dexterous grasp generation that considers arm-related constraints is crucial in real-world scenarios involving arm-environment collision avoidance, workspace boundary grasps, and consecutive grasping. Existing hand-centric grasp models, which primarily focus on the floating hand's pose, are insufficient for such cases. Conventional arm-aware methods either rely on rejection sampling to discard infeasible samples or require retraining on arm-specific data, leading to low sample efficiency under adverse conditions or limited generalization across different robots and environments. To overcome these limitations, this letter presents an arm-aware dexterous grasp generation framework that leverages pretrained arm-agnostic grasp models while integrating arm and environmental information only at inference time. Specifically, we formulate arm-aware constrained grasp generation as a joint optimization of hand pose and arm configuration, and derive closed-form gradients for arm-related constraints. Assuming the hand pose distribution is represented by a diffusion model, we prove that gradient-based optimization is equivalent to guided diffusion sampling, steering near-feasible samples toward the feasible region. Through comprehensive evaluation involving 10 k objects across 6 scenarios, we demonstrate that the proposed framework generates feasible grasps in highly constrained settings with significantly higher probability, highlighting its advantages in real-world applications.
Tsinghua AI