Search papers, labs, and topics across Lattice.
The paper introduces TactiVerse, a U-Net-based framework for estimating contact geometry in soft robots by predicting spatial heatmaps of deformation. TactiVerse is trained primarily on single-point indentation data and achieves state-of-the-art single-point sensing accuracy, outperforming CNN-based regression models. Augmenting the training data with multi-point contact examples significantly improves multi-point sensing capabilities, demonstrating the framework's ability to generalize to complex tactile scenarios.
Forget painstakingly collecting multi-point tactile data: TactiVerse shows you can train a U-Net on mostly single-point indentations and still nail complex multi-point contact geometry estimation in soft robots.
Real-time prediction of deformation in highly compliant soft materials remains a significant challenge in soft robotics. While vision-based soft tactile sensors can track internal marker displacements, learning-based models for 3D contact estimation heavily depend on their training datasets, inherently limiting their ability to generalize to complex scenarios such as multi-point sensing. To address this limitation, we introduce TactiVerse, a U-Net-based framework that formulates contact geometry estimation as a spatial heatmap prediction task. Even when trained exclusively on a limited dataset of single-point indentations, our architecture achieves highly accurate single-point sensing, yielding a superior mean absolute error of 0.0589 mm compared to the 0.0612 mm of a conventional regression-based CNN baseline. Furthermore, we demonstrate that augmenting the training dataset with multi-point contact data substantially enhances the sensor's multi-point sensing capabilities, significantly improving the overall mean MAE for two-point discrimination from 1.214 mm to 0.383 mm. By successfully extrapolating complex contact geometries from fundamental interactions, this methodology unlocks advanced multi-point and large-area shape sensing. Ultimately, it significantly streamlines the development of marker-based soft sensors, offering a highly scalable solution for real-world tactile perception.
