Search papers, labs, and topics across Lattice.
This paper introduces UniTacVLA, a unified tactile learning framework that enhances vision-language-action (VLA) models by treating tactile signals as dynamic interaction cues for contact-rich manipulation tasks. By constructing a unified tactile latent space and employing tactile chain-of-thought reasoning, the model effectively predicts future tactile states and refines actions through a tactile-action mixed controller. Experimental results across various manipulation tasks demonstrate significant improvements in success rates, accuracy, and robustness compared to existing methods, underscoring the framework's effectiveness in facilitating dexterous physical interactions.
Treating tactile signals as active cues rather than passive inputs leads to a dramatic boost in manipulation success rates and accuracy in contact-rich tasks.
Vision-language-action (VLA) models have achieved strong performance in many robotic manipulation tasks, yet remain limited in contact-rich dexterous manipulation. To overcome this limitation, recent vision-tactile-language-action (VTLA) methods incorporate tactile sensing into VLA models to provide direct contact information. However, they typically treat tactile signals as passive auxiliary inputs, making it difficult to model tactile semantics and future physical interactions. To this end, we propose a unified tactile learning framework for contact-rich manipulation that models tactile signals as dynamic interaction cues for both contact understanding and prediction. Specifically, we construct a unified tactile latent space and jointly model current tactile states and future contact changes through tactile chain-of-thought reasoning and coarse-to-fine future tactile prediction, thereby forming a state-aware and dynamics-aware tactile prior. Based on this prior, we introduce a tactile-action mixed controller that combines real-time and predicted tactile feedback to refine low-frequency action chunks with high-frequency corrections. Real-world experiments on four categories of contact-rich tasks, including adjustment, insertion, wiping, and assembly, under both clean and externally perturbed settings, show that our method improves success rate, manipulation accuracy, and contact robustness over existing methods, demonstrating its effectiveness in dexterous physical interaction.
