Search papers, labs, and topics across Lattice.
This paper introduces Cardinality-Decomposed Loss (CDL), a novel loss function that integrates Cross Entropy and Bayesian Personalized Ranking to optimize for heterogeneous relations in recommendation systems. The authors identify that traditional BPR can lead to the collapse of attribute embeddings, negatively impacting user node embeddings and downstream tasks like personalization. Evaluations across multiple datasets demonstrate that CDL enhances the discriminability of attribute embeddings and improves ranking metrics when attribute signals are strong, while also revealing critical insights about the interplay between semantic alignment and topology leakage in graph structures.
Traditional loss functions can silently degrade recommendation quality, but the new Cardinality-Decomposed Loss reveals how to optimize for diverse relational structures effectively.
Graph Neural Networks trained on heterogenous bipartite graphs form a common basis in recommendation systems. These graphs often express relations that vary in cardinality, for example, user-item preferences are one-to-many and user-attribute features are one-to-one. Traditionally, a unique loss function is applied for all of the network components which is often Bayesian Personalized Ranking (BPR). While BPR works well for the recommendation task, we find that it causes attribute embeddings to collapse to near-random geometry -- a silent failure that leaves standard ranking metrics largely unaffected and therefore invisible to conventional evaluation. This in turn pollutes user node embeddings, which are shaped by both edge types simultaneously, hurting downstream tasks like personalization, segmentation, etc. Here we propose a Cardinality-Decomposed Loss (CDL) that combines both Cross Entropy (CE) and BPR to enable the model to collectively optimize for relations across cardinalities. We confirm this CE-BPR conflict by showing the two losses compete in the shared encoder's parameter space. We evaluate CDL on five datasets spanning two structural configurations -- one-to-one attributes on user nodes (MovieLens-1M, Last.fm-360K, PayPal Audience Factory, BookCrossing) and on item nodes (Yelp) -- and find that CDL consistently improves discriminability in attribute embeddings. We also show that ranking (NDCG) improves when attributes carry meaningful preference signal, but conflicts with it when the correlation is weak. We use a lambda parameter to navigate this trade-off, and a lambda-sweep reveals that dataset behavior is governed by two graph properties -- semantic alignment and topology leakage. Semantic alignment measures whether the attribute predicts preferences, while topology leakage measures whether the graph's connectivity already encodes it.
