Search papers, labs, and topics across Lattice.
This paper introduces TacReasoner, a dynamic tactile-language framework designed to enhance interactive reasoning in real-world scenarios by addressing the challenges of dynamic tactile signal modeling and hallucination in tactile foundation models. By incorporating a Dynamic-aware Tactile Encoder and introducing the TouchCoT-10k dataset for structured reasoning, TacReasoner significantly improves the perception of tactile inputs and enables stable inference. Experimental results reveal that TacReasoner, with only 7B parameters, outperforms larger models like the 14B VTV-LLM in various reasoning tasks, underscoring its efficiency and effectiveness in tactile commonsense reasoning.
TacReasoner outperforms larger models in tactile reasoning tasks, achieving competitive results with fewer parameters.
Among the five primary human senses, tactile is arguably the most fundamental to survival, as it enables the perception of physical contact and interaction in real-world environments. In this paper, we explore two key challenges of integrating tactile sensing into intelligent systems for multimodal reasoning: (i) insufficient modeling of dynamic tactile signals, which restricts reasoning over temporally evolving properties, and (ii) hallucination in tactile foundation models caused by the absence of explicit reasoning mechanisms, leading to unstable real-world inference. To address these challenges, we propose TacReasoner, a dynamic tactile-language framework for interactive reasoning in real-world scenarios. First, TacReasoner incorporates a Dynamic-aware Tactile Encoder to enhance the perception and representation of dynamic tactile signals. More importantly, we introduce TouchCoT-10k, the first tactile chain-of-thought dataset for structured reasoning over tactile inputs. Upon it, we establish DynTac-Bench to systematically evaluate dynamic tactile perception and real-world commonsense reasoning. Experimental results demonstrate that TacReasoner achieves competitive performance against state-of-the-art models across multiple datasets. Notably, despite using only 7B parameters, TacReasoner outperforms the 14B VTV-LLM model on most subtasks, highlighting its effectiveness and efficiency in tactile commonsense reasoning.
