Search papers, labs, and topics across Lattice.
This paper introduces a novel 3D keypoint-based modular learning framework, PVRA, designed to enhance autonomous robotic assembly by learning assembly dependencies from RGB-D inputs. By conducting a comparative analysis against object-centric baselines, the authors demonstrate that their approach significantly improves the prediction of actionable outputs necessary for effective manipulation in progressive assembly tasks. The results indicate that PVRA outperforms existing methods, highlighting the importance of integrating assembly dependency learning into robotic perception systems.
Learning assembly dependencies can drastically improve robotic manipulation, outperforming traditional object-centric approaches in complex tasks.
Modern computer vision has enabled partial autonomy in robotic assembly manipulation. However, performing autonomous manipulation of a progressive assembly demands a more specific set of skills, in addition to perceiving the objects. Through a comparative analysis of research in the associated domains, we deduce that object-centric perception must advance towards learning assembly dependencies to predict meaningful actionable outputs for autonomous assembly manipulation. Subsequently, we present a 3D keypoint-based modular learning framework to learn assembly dependencies to infer actionable outputs given a RGB-D input of an assembly scene. We train and evaluate our trained network on an assembly pose estimation dataset and compare it against object-centric baselines with an augmented set of metrics for progressive assemblies.
