Search papers, labs, and topics across Lattice.
This paper introduces a reinforcement learning approach, Mode-Aware Training for Contact Handling (MATCH), to learn hybrid position-force control policies for high-precision in-contact manipulation. MATCH dynamically selects between force and position control in each dimension, improving learning efficiency by adjusting policy action probabilities to reflect mode selection behavior. Experiments on fragile peg-in-hole tasks under localization uncertainty demonstrate that MATCH outperforms pose-control policies, achieving higher success rates, fewer peg breaks, and improved sim-to-real transfer with reduced force application.
Force-guided robot finesse is now within reach: MATCH learns hybrid position-force control that doubles success rates in real-world, high-noise insertion tasks compared to traditional pose control.
Reinforcement learning-based control policies have been frequently demonstrated to be more effective than analytical techniques for many manipulation tasks. Commonly, these methods learn neural control policies that predict end-effector pose changes directly from observed state information. For tasks like inserting delicate connectors which induce force constraints, pose-based policies have limited explicit control over force and rely on carefully tuned low-level controllers to avoid executing damaging actions. In this work, we present hybrid position-force control policies that learn to dynamically select when to use force or position control in each control dimension. To improve learning efficiency of these policies, we introduce Mode-Aware Training for Contact Handling (MATCH) which adjusts policy action probabilities to explicitly mirror the mode selection behavior in hybrid control. We validate MATCH's learned policy effectiveness using fragile peg-in-hole tasks under extreme localization uncertainty. We find MATCH substantially outperforms pose-control policies -- solving these tasks with up to 10% higher success rates and 5x fewer peg breaks than pose-only policies under common types of state estimation error. MATCH also demonstrates data efficiency equal to pose-control policies, despite learning in a larger and more complex action space. In over 1600 sim-to-real experiments, we find MATCH succeeds twice as often as pose policies in high noise settings (33% vs.~68%) and applies ~30% less force on average compared to variable impedance policies on a Franka FR3 in laboratory conditions.
