Search papers, labs, and topics across Lattice.
The paper introduces Sound of Touch, an active acoustic tactile sensing method using electromagnetically vibrated tensioned strings to detect contact. By analyzing spectral changes in short-duration audio signals from contact microphones, the system estimates contact location, normal force, and slip. The authors validate their approach with experiments demonstrating millimeter-scale localization and real-time slip detection, supported by a physics-based string-vibration simulator.
Imagine giving robots a sense of touch as sensitive as a spiderweb, using nothing more than vibrating strings and microphones.
Distributed tactile sensing remains difficult to scale over large areas: dense sensor arrays increase wiring, cost, and fragility, while many alternatives provide limited coverage or miss fast interaction dynamics. We present Sound of Touch, an active acoustic tactile-sensing methodology that uses vibrating tensioned strings as sensing elements. The string is continuously excited electromagnetically, and a small number of pickups (contact microphones) observe spectral changes induced by contact. From short-duration audio signals, our system estimates contact location and normal force, and detects slip. To guide design and interpret the sensing mechanism, we derive a physics-based string-vibration simulator that predicts how contact position and force shift vibration modes. Experiments demonstrate millimeter-scale localization, reliable force estimation, and real-time slip detection. Our contributions are: (i) a lightweight, scalable string-based tactile sensing hardware concept for instrumenting extended robot surfaces; (ii) a physics-grounded simulation and analysis tool for contact-induced spectral shifts; and (iii) a real-time inference pipeline that maps vibration measurements to contact state.
CMU ML