Search papers, labs, and topics across Lattice.
The paper introduces M2-ResiPolicy, a hierarchical control framework for contact-rich manipulation that combines a diffusion-based Master-Guidance Policy (MGP) for high-level planning with a GRU-based Micro-Residual Corrector (MRC) for real-time force feedback. MGP adaptively fuses vision and tactile information, while MRC compensates for interaction forces at a higher frequency, and a force-mixed PBIC execution layer ensures interaction safety. Experiments on tasks like fragile object grasping and precision insertion show M2-ResiPolicy significantly outperforms existing diffusion policies, achieving a 93% damage-free success rate in chip grasping and improved force regulation.
Achieve 93% damage-free success in fragile object grasping by fusing diffusion-based planning with real-time force feedback, outperforming state-of-the-art reactive diffusion policies.
Robotic contact-rich and fine-grained manipulation remains a significant challenge due to complex interaction dynamics and the competing requirements of multi-timescale control. While current visual imitation learning methods excel at long-horizon planning, they often fail to perceive critical interaction cues like friction variations or incipient slip, and struggle to balance global task coherence with local reactive feedback. To address these challenges, we propose M2-ResiPolicy, a novel Master-Micro residual control architecture that synergizes high-level action guidance with low-level correction. The framework consists of a Master-Guidance Policy (MGP) operating at 10 Hz, which generates temporally consistent action chunks via a diffusion-based backbone and employs a tactile-intensity-driven adaptive fusion mechanism to dynamically modulate perceptual weights between vision and touch. Simultaneously, a high-frequency (60 Hz) Micro-Residual Corrector (MRC) utilizes a lightweight GRU to provide real-time action compensation based on TCP wrench feedback. This policy is further integrated with a force-mixed PBIC execution layer, effectively regulating contact forces to ensure interaction safety. Experiments across several demanding tasks including fragile object grasping and precision insertion, demonstrate that M2-ResiPolicy significantly outperforms standard Diffusion Policy (DP) and state-of-the-art Reactive Diffusion Policy (RDP), achieving a 93\% damage-free success rate in chip grasping and superior force regulation stability.
