Search papers, labs, and topics across Lattice.
FastGrasp, a learning-based framework, is introduced to address the challenges of impact stabilization, real-time whole-body coordination, and generalization in mobile fast grasping. The method employs a two-stage reinforcement learning strategy, using a conditional variational autoencoder to generate grasp candidates and tactile sensing for real-time adjustments. Experiments show FastGrasp achieves robust manipulation across diverse object geometries with effective sim-to-real transfer, outperforming existing methods.
Mobile robots can now achieve robust, high-speed grasping across diverse objects thanks to a novel learning framework that coordinates base, arm, hand, and tactile feedback.
Fast grasping is critical for mobile robots in logistics, manufacturing, and service applications. Existing methods face fundamental challenges in impact stabilization under high-speed motion, real-time whole-body coordination, and generalization across diverse objects and scenarios, limited by fixed bases, simple grippers, or slow tactile response capabilities. We propose \textbf{FastGrasp}, a learning-based framework that integrates grasp guidance, whole-body control, and tactile feedback for mobile fast grasping. Our two-stage reinforcement learning strategy first generates diverse grasp candidates via conditional variational autoencoder conditioned on object point clouds, then executes coordinated movements of mobile base, arm, and hand guided by optimal grasp selection. Tactile sensing enables real-time grasp adjustments to handle impact effects and object variations. Extensive experiments demonstrate superior grasping performance in both simulation and real-world scenarios, achieving robust manipulation across diverse object geometries through effective sim-to-real transfer.