Search papers, labs, and topics across Lattice.
This paper introduces a novel framework for dense 3D force field reconstruction using event-based optical tactile sensors, overcoming limitations of traditional vision-based sensors. By estimating 3D surface displacements from event data and mapping them to forces through the inverse Finite Elements Method (iFEM), the authors achieve accurate force reconstructions with low mean absolute error across various force ranges. The proposed method significantly enhances the temporal resolution and accuracy of tactile feedback, paving the way for improved robotic grasping and manipulation capabilities.
Achieving mean absolute errors as low as 0.14 N in dense force estimation could revolutionize tactile feedback in robotic systems.
Humans rely on spatially dense, geometry and force-aware tactile feedback at high temporal resolution for dexterous manipulation. While vision-based tactile sensors enable dense force estimation, they are limited by camera frame rates, motion blur, and data bandwidth. Event-based optical tactile sensors offer an attractive alternative with microsecond temporal resolution and low motion blur, but existing methods are restricted to predicting only net forces. We introduce the first framework for dense 3D force field reconstruction using event-based optical tactile sensors. Our approach estimates 3D surface displacements from event data and maps them to forces via the inverse Finite Elements Method (iFEM). Shear displacements are recovered through the proposed event-based marker tracking algorithm, while normal displacements are predicted by a convolutional neural network trained on a collected dataset of synchronized force-displacement-event data. Experiments demonstrate accurate reconstruction of physically grounded forces, achieving a mean absolute error of (0.14 N, 0.10 N, 0.93 N) over force ranges up to (4 N, 4 N, 20 N), while operating at an average of 100 Hz. This work constitutes a first step toward enabling dense force feedback for high-frequency control in robotic grasping and dexterous manipulation.
