Search papers, labs, and topics across Lattice.
This paper investigates the limitations of existing LLM-enhanced recommendation systems that align semantic representations with collaborative embeddings, revealing that such alignment often neglects valuable non-principal semantic components. By employing a spectral perspective, the authors show that collaborative and semantic signals thrive in different spectral regions, with alignment leading to a concentration of representations that diminishes the utility of non-principal components. The proposed UniSpecRec method leverages signal-specific spectral filtering to maintain the integrity of both collaborative and semantic representations, resulting in superior performance without the need for cross-space alignment or additional parameters.
Aligning semantic and collaborative signals in LLM-enhanced recommendations may actually hinder performance by ignoring valuable non-principal information.
Recent advances in LLM-enhanced recommendation commonly align semantic representations with collaborative embeddings in a shared space, yet how alignment affects LLM-encoded information remains unclear. In this work, we revisit LLM-enhanced recommendation from a spectral perspective and show that collaborative and semantic signals benefit from different spectral parts. While collaborative representations are dominated by smooth low-frequency components due to user-item homophily, semantic embeddings contain useful non-principal singular components. Through component-wise evaluation and training-dynamics analysis, we find that alignment increasingly concentrates learned representations in dominant collaborative and principal semantic subspaces, reducing overlap with non-principal semantic components. Controlled comparisons show that non-principal components provide inconsistent gains under alignment but consistently improve performance through component-level decoupling, while full prediction-level decoupling achieves the best overall performance. These results indicate that alignment fails to effectively exploit complementary non-principal semantic information. Motivated by these findings, we propose UniSpecRec (Unifying Spectral Signals for Recommendation), which applies signal-specific spectral filtering while preserving collaborative and semantic representations in their respective spaces. UniSpecRec combines their predictions without cross-space alignment or additional trainable parameters. Extensive experiments demonstrate its effectiveness, efficiency, and generalizability.
