Search papers, labs, and topics across Lattice.
This study introduces a wearable glove that employs a visual-to-haptic mapping algorithm to enhance tactile perception in Extended Reality (XR) environments. By translating visual features from images and videos into vibrotactile patterns, the glove significantly improves the perceived realism and immersion of users during dynamic video interactions. Results from a user study reveal that tactile augmentation leads to stronger visual-tactile correspondence, particularly in scenarios involving motion and dynamic content, suggesting a promising avenue for enriching multimodal XR experiences.
Tactile augmentation in XR can dramatically enhance user immersion and realism, especially during dynamic visual interactions.
Extended Reality (XR) systems increasingly deliver high-fidelity visual and auditory experiences, yet tactile perception remains comparatively underutilized as a modality for enriching embodied interaction. This work presents a visual-to-haptic wearable glove and a feature-based visual-to-haptic mapping algorithm that translates spatial and temporal visual features from images and videos into distributed vibrotactile patterns. The proposed method extracts motion, edge, and brightness cues and fuses them into actuator-level intensity maps aligned with a 29-actuator glove arranged in a five-by-seven layout. The system is implemented through a modular four-layer architecture comprising the XR environment, media content handling, visual-to-haptic processing, and embedded haptic hardware. A within-subject user study (N = 20) compared visual-only interaction with visual-plus-haptic augmentation across texture-based and dynamic video scenarios. Results indicate that tactile augmentation significantly improves perceived realism in dynamic video scenarios and enhances immersion and visual-tactile correspondence across conditions, with stronger and more consistent effects observed for dynamic visual events. While the current implementation operates in a single-user, offline-synchronized configuration, the findings demonstrate that vision-driven tactile augmentation can function as a perceptual enhancement layer within multimodal XR systems. Such a layer may provide a foundation for future socially enriched XR environments where coherent multisensory grounding supports higher-level interaction and communication.
