Search papers, labs, and topics across Lattice.
This paper introduces Unpaired Modality-Agnostic Generative Recommendation (UnpairGR), which innovatively learns a unified semantic-ID space from both paired and unpaired observations across different modalities. By employing lightweight input projections for modality-specific processing and sharing Transformer and residual codebooks, UnpairGR effectively overcomes the limitations of traditional multimodal generative recommendation systems that rely on item-level paired observations. Experimental results across three benchmark datasets reveal that UnpairGR significantly enhances recommendation performance, even in scenarios with incomplete observations.
UnpairGR achieves superior recommendation performance by leveraging both paired and unpaired modality observations without the need for complex feature imputation or modality-specific codebooks.
Generative Recommendation (GR) formulates recommendation as autoregressive generation over discrete semantic identifiers (IDs). Although recent multimodal GR methods improve semantic ID construction with visual and textual information, they typically require item-level paired observations, restricting tokenization to the intersection of modality availability. Moreover, incorporating unpaired observations is nontrivial because small representation shifts may cross quantization boundaries and produce incompatible identifier sequences. To address this challenge, we propose \textbf{Unpair}ed Modality-Agnostic \textbf{G}enerative \textbf{R}ecommendation (UnpairGR), which learns a unified semantic-ID space from paired, image-only, and text-only observations. UnpairGR confines modality-specific processing to lightweight input projections while sharing the subsequent Transformer and residual codebooks across all observation conditions. Paired observations establish a reliability-guided cross-modal consensus, whereas unimodal observations directly refine the same representations and codes. The learned tokenizer is then fixed to provide stationary targets for a single autoregressive recommender, without feature imputation, modality-specific codebooks, or fallback mappings. Extensive experiments on three benchmark datasets demonstrate that UnpairGR consistently improves recommendation performance under both fully observed and incomplete-observation settings.
