Search papers, labs, and topics across Lattice.
The paper introduces GCNGrasp-VP, a novel framework that combines affordance field prediction with active view planning to enhance task-oriented grasping in the presence of occlusions. By integrating a task-oriented grasp model, GCNGrasp-v2, which allows for efficient grasp evaluation and affordance prediction, the framework achieves constant-time inference while guiding camera observations based on task-relevant regions. Experimental results demonstrate that GCNGrasp-VP significantly outperforms traditional scene-uncertainty-driven methods, achieving higher grasp success rates with minimal computational latency in real-world scenarios.
Grasping performance can be dramatically improved with a single view adjustment that leverages affordance fields, bypassing the need for complex scene reconstruction.
Task-oriented grasping performance degrades significantly when object views suffer from occlusions. Existing task-oriented grasping methods typically assume task-relevant regions are visible in the initial frame, while view planning approaches enable active perception but often ignore task semantics and rely on time-consuming scene reconstruction. To address these limitations, we present GCNGrasp-VP, an efficient framework integrating affordance field prediction with active view planning. Central to this framework is GCNGrasp-v2, a task-oriented grasp model that simultaneously supports grasp evaluation and affordance field prediction, achieving constant-time inference complexity. Leveraging this capability, our Affordance-guided View Planner (Affordance-VP) utilizes the affordance field as an information gain metric to guide camera observation of task-relevant regions without requiring scene reconstruction. View planning results show that our method significantly outperforms scene-uncertainty-driven baselines with only one view adjustment. Real-world validation further confirms substantial improvements in grasp success rates for single-object scenarios while maintaining millisecond-level computational latency. Code and models are available at https://github.com/Instinct323/GCNGrasp-VP.
