Search papers, labs, and topics across Lattice.
This paper investigates how popularity-biased feedback influences the geometry of collaborative-filtering embeddings, focusing on the mean-centered user covariance to measure user distinguishability. The authors establish that under such feedback, the covariance converges to a steady state that reflects item-noise characteristics, leading to a collapse in between-user spread toward a noise floor. They derive a computable phase boundary in hyperparameter space that delineates conditions for contraction versus expansion, validated through experiments on the MovieLens-25M dataset, revealing that while the predicted contraction is present, it does not translate to improved recommendation metrics.
Popularity-biased feedback can collapse user representation into a noise floor, challenging the effectiveness of collaborative filtering in real-world applications.
We study how popularity-biased BPR training reshapes the between-user geometry of collaborative-filtering embeddings. We work with the mean-centered user covariance $C=\tfrac1n U^\top H U$, the object that measures how distinguishable users are from one another, as opposed to the uncentered second moment used in prior work. We prove that under popularity-biased feedback with stationary items, $C$ converges to a steady state proportional to the item-noise covariance $Q$. Thus between-user spread collapses toward a noise floor. We derive a closed-form, computable phase boundary in the training hyperparameters $(\alpha,\lambda_{neg},\gamma,d)$ separating contraction from expansion, and validate both directional predictions on MovieLens-25M. We then examine the limits of the effect. At deployment-scale regularization the predicted contraction is real and policy-driven but small, and it is not reflected in any recommendation-level metric we measured. The $\alpha$-driven anisotropic-collapse mechanism operates only at regularization strengths that degrade the recommender. A deployment-time restoration intervention derived from the theory does not improve recommendation quality. The boundary is computable from a trained model's embeddings, item interaction counts, and training hyperparameters, so a practitioner can check whether a deployed system sits in the strong-collapse regime without simulating the feedback loop. In our experiments the boundary places deployable settings far from that regime.
