Search papers, labs, and topics across Lattice.
This paper introduces a force-aware control framework for humanoid robots with multi-fingered hands, enabling stable object manipulation by adapting the robot's pose and redistributing forces based on tactile sensor feedback. Force estimation is achieved by training a model on a dataset of tactile signals from Xela sensors and corresponding ground-truth force measurements. The control scheme minimizes the distance between the Center of Pressure (CoP) and the centroid of the fingertips' contact polygon, demonstrating successful balancing and multi-object manipulation tasks.
Humanoid robots can now juggle objects more reliably thanks to a force-aware controller that intelligently redistributes forces across the hand and body.
In this paper, we address force-aware control and force distribution in robotic platforms with multi-fingered hands. Given a target goal and force estimates from tactile sensors, we design a controller that adapts the motion of the torso, arm, wrist, and fingers, redistributing forces to maintain stable contact with objects of varying mass distribution or unstable contacts. To estimate forces, we collect a dataset of tactile signals and ground-truth force measurements using five Xela magnetic sensors interacting with indenters, and train force estimators. We then introduce a model-based control scheme that minimizes the distance between the Center of Pressure (CoP) and the centroid of the fingertips contact polygon. Since our method relies on estimated forces rather than raw tactile signals, it has the potential to be applied to any sensor capable of force estimation. We validate our framework on a balancing task with five objects, achieving a $82.7\%$ success rate, and further evaluate it in multi-object scenarios, achieving $80\%$ accuracy. Code and data can be found here https://github.com/hsp-iit/multifingered-force-aware-control.