Search papers, labs, and topics across Lattice.
This paper introduces FasTac, a novel curved multispectral vision-based tactile sensor designed to enhance dexterous manipulation by accurately resolving fine contact geometry and estimating three-axis forces at high speeds. By integrating multispectral photometric stereo with dynamic-convolution force estimation on an FPGA, FasTac achieves significant improvements in depth reconstruction accuracy and processing latency. Experimental results demonstrate a reduction in depth mean absolute error from 0.2730 mm to 0.0415 mm and a processing latency decrease from 3.26 ms to 1.09 ms, showcasing its potential for real-time applications in robotics and tactile sensing.
FasTac reduces depth estimation error by over 85% while processing tactile data more than three times faster than conventional methods.
Curved tactile fingertips for dexterous manipulation must resolve fine contact geometry, distinguish normal and tangential loads, and capture transient signals. Existing curved vision-based tactile sensors struggle to combine accurate 3D reconstruction, three-axis force estimation, and high-speed processing in a compact form. This article presents FasTac, a curved vision-based tactile sensor integrating multispectral photometric stereo, dynamic-convolution force estimation, and hardware acceleration on a field-programmable gate array (FPGA). Single-image-sensor simultaneous multispectral imaging provides spatially aligned observations for robust surface normal estimation, followed by boundary-prior fast Poisson depth reconstruction. HyperForce uses position-aware dynamic convolution to model the spatially nonuniform mechanical response of curved elastomers and estimate three-axis forces. The complete image-to-normal-force pipeline is deployed on an FPGA. Experiments show that near-infrared (NIR) illumination and the boundary prior decrease depth mean absolute error (MAE) from 0.2730 mm to 0.0415 mm; HyperForce achieves normalized mean absolute error (NMAE) values of 2.74% and 2.39% for normal and shear forces, respectively; and FPGA deployment shortens processing latency from 3.26 ms on the GPU to 1.09 ms. Multi-object reconstruction, feedback grasping, and vibration measurement validate fine geometric perception, stable force feedback, and dynamic contact sensing.
