Search papers, labs, and topics across Lattice.
This paper introduces REVEAL, a novel framework designed to enhance multimodal sequential recommendation (MSR) by improving visual representation learning and optimizing the balance between visual and textual features. The authors identify that existing models underutilize visual information due to inadequate representation learning and an imbalance favoring textual signals. Through empirical validation across various datasets, REVEAL demonstrates significant improvements in recommendation performance by refining visual extraction and dynamically adjusting the learning focus on visual modalities.
Visual features can be the game-changer in recommendation systems, but they鈥檙e often overlooked鈥擱EVEAL flips the script by making them a focal point.
Multimodal sequential recommendation (MSR) incorporates textual and visual information to improve recommendation quality. However, recent studies and our empirical analysis show that visual features are often underutilized, thereby contributing far less than textual signals. We attribute this issue to two factors: insufficient visual representation learning (pretrained encoders fail to capture preference-relevant cues) and unbalanced visual-text optimization (textual features dominate the learning process). To address these issues, we propose Teach Multimodal Recommendation Model to See via Personalized Visual Extraction and Adaptive Learning (REVEAL), a plug-and-play framework that enhances visual representation learning and cross-modal optimization without modifying the original recommendation backbone. REVEAL consists of Feedback-Guided Visual Extraction (FVE), which refines prompt-guided visual extraction through task-level feedback, and Adaptive Visual Learning (AVL), which dynamically reweights visual learning to alleviate modality imbalance. Experiments on multiple real-world datasets and MSR backbones demonstrate that REVEAL consistently improves recommendation performance. Further analysis shows that these gains arise from more effective attention to preference-relevant visual regions and better visual utilization during training. The code is available at https://github.com/YutongLi2024/REVEAL.
