Search papers, labs, and topics across Lattice.
This survey analyzes 85 papers to characterize the growing adoption of Language Models (LMs) within the Mining Software Repositories (MSR) field, which extracts insights from software repositories. The study categorizes LM applications in MSR, identifies trends in model usage and analyzed artifacts, and assesses reproducibility. The analysis reveals key challenges and suggests future research directions for leveraging LMs to analyze software repositories.
LMs are rapidly transforming software repository mining, but their inconsistent application and lack of reproducibility pose significant challenges for realizing their full potential.
The Mining Software Repositories (MSR) field focuses on analysing the rich data contained in software repositories to derive actionable insights into software processes and products. Mining repositories at scale requires techniques capable of handling large volumes of heterogeneous data, a challenge for which language models (LMs) are increasingly well-suited. Since the advent of Transformer-based architectures, LMs have been rapidly adopted across a wide range of MSR tasks. This article presents a comprehensive survey of the use of LMs in MSR, based on an analysis of 85 papers. We examine how LMs are applied, the types of artefacts analysed, which models are used, how their adoption has evolved over time, and the extent to which studies support reproducibility and reuse. Building on this analysis, we propose a taxonomy of LM applications in MSR, identify key trends shaping the field, and highlight open challenges alongside actionable directions for future research.
