Search papers, labs, and topics across Lattice.
This paper introduces Stresa, a stream-aware side-adaptation framework designed to enhance the performance of large pre-trained multimodal embedding models in sequential recommendation tasks. By addressing challenges related to domain misalignment and the degradation of performance with deeper layers, Stresa employs Stream-aware Hidden-Adapter Fusion (SHAF) and Residual Stream Adapter (ReSA) to effectively preserve historical representations and optimize residual updates. The empirical results demonstrate that Stresa consistently outperforms standard side adapters and state-of-the-art methods across various public datasets, underscoring its effectiveness in leveraging large multimodal models for improved recommendation outcomes.
Stream-aware adaptation can significantly enhance the performance of large multimodal models in sequential recommendation, overcoming traditional limitations of layer degradation.
Recently, large pretrained multimodal embedding models such as Qwen3-VL Embedding have shown strong promise for sequential recommendation, as they provide reusable semantic item representations across modalities and domains. However, directly using these embeddings often leads to suboptimal performance because of domain misalignment. Efficient side adaptation is therefore an attractive solution. Although adapting all backbone layers should help, existing side adapters often degrade with depth, prompting layer dropping despite the loss of useful hidden states. This is due to two major challenges: (1) the lack of modeling in selecting fused representations during residual addition, and (2) the insufficient preservation of earlier representations during progressive sigmoid fusion. This paper therefore asks a practical question: How can we design a side adaptation approach that effectively unlocks the potential of large pre-trained multimodal embedding models? To address this question, we propose Stresa, a stream-aware side-adaptation framework for frozen large pre-trained multimodal embedding models in sequential recommendation. Stresa introduces Stream-aware Hidden-Adapter Fusion (SHAF) to preserve historical side memory during fusion and Residual Stream Adapter (ReSA) to produce selective residual updates across layers. Empirically, Stresa consistently outperforms standard side adapters and state-of-the-art baselines on public datasets across multiple backbone embedding models. These results highlight the promise of adapting large embedding models for sequential recommendation. Our code is publicly available at https://github.com/GAIR-Lab/Stresa.
