Search papers, labs, and topics across Lattice.
This paper evaluates unsupervised collaboration recommendation methods in scholarly contexts by comparing TF-IDF, topic-based models (LDA and BERTopic), and embedding-based retrieval using SciBERT with Faiss. The study reveals that while TF-IDF excels with complete data, its performance declines sharply when publication overlap is minimized, unlike the more robust topic-based and embedding methods that maintain stability by leveraging broader distributional similarities. Additionally, the authors explore explainability through intrinsic topic-based and post-hoc retrieval-based approaches, highlighting the trade-offs between transparency and readability in the recommendations.
Topic-based and embedding methods outperform TF-IDF in collaboration recommendations, maintaining stability even with reduced publication overlap.
In this paper, we examine unsupervised, content-based collaboration recommendations using publication text in scholarly settings. We compare three families of methods: a TF-IDF baseline, topic-based models (LDA and BERTopic, including clone variants), and embedding-based retrieval using SciBERT with Faiss. To evaluate model behavior beyond simple lexical matching, we introduce a constrained setting where publication overlap between researchers is partially removed while still using historical co-authorship as proxy ground truth for post-hoc evaluation. Results show clear differences across methods. TF-IDF performs best under full information but drops significantly as overlap is reduced. In contrast, topic-based and embedding-based approaches show more stable performance, suggesting they capture broader distributional similarities, rather than relying only on direct lexical overlap. We also examine explainability through two perspectives: intrinsic topic-based explanations and post-hoc, retrieval-based explanations generated using language models. These provide complementary trade-offs between transparency and human readability.
