Search papers, labs, and topics across Lattice.
The paper investigates how multimodal signals interact with ranking pipelines in recommendation systems, finding that moderate cross-view agreement is optimal as strong agreement suppresses recommendation-specific variation. They propose a behavior-guided candidate calibration model that leverages co-user overlap as signed candidate evidence applied to the shortlist generated by a multimodal backbone. Experiments on Amazon datasets demonstrate consistent improvements over strong multimodal baselines by stabilizing the representation space and focusing behavior evidence on the ranking decision stage.
Multimodal recommendation models perform best when content signals have *moderate* agreement, suggesting that diversity, not just agreement, is key for effective ranking.
Multimodal recommendation benefits from content signals, but the gain depends on how those signals interact with the ranking pipeline. We find that moderate cross-view agreement helps, while stronger agreement suppresses recommendation-specific variation. Spectral analysis shows a clear split: low-frequency components capture shared structure, and higher-frequency components preserve more discriminative signal. Based on this finding, we introduce a behavior-guided candidate calibration model that converts training-only co-user overlap into signed candidate evidence and applies it only to the shortlist produced by the multimodal backbone. The backbone keeps the representation space stable; behavior evidence acts only where ranking is decided. Results on Amazon Baby, Sports, and Electronics show consistent gains over strong multimodal baselines. Code is available at https://github.com/LIZESHENG13/bridge.