Search papers, labs, and topics across Lattice.
This paper introduces Semref, a framework that utilizes large language models (LLMs) in conjunction with dependency analysis to enhance the accuracy of architecture recovery from software systems. By addressing the common discrepancies between designed and implemented architectures, Semref significantly reduces the manual effort required for refining recovery results. Evaluation across nine projects demonstrates that Semref achieves accuracy improvements ranging from 17.72% to 43.35%, with notable enhancements of 118.57% and 100.41% for specific metrics.
Semref leverages LLMs to automatically refine architecture recovery results, achieving up to 118.57% improvement in accuracy over traditional methods.
Understanding the architecture is crucial for effectively maintaining and managing large software systems. However, discrepancies often exist between the designed and implemented architectures, which can pose significant risks. To identify these discrepancies, architects need to extract the architecture from the system implementation, which is both time-consuming and error-prone. To simplify this procedure, many automatic architecture recovery techniques have been developed. Yet, their accuracy is often limited. Architects must still invest significant effort in refining recovery results to ensure they accurately reflect the implemented architecture. To reduce such manual effort, we introduce Semref, a framework that combines LLMs with dependency analysis to automatically refine architectures recovered by existing architecture recovery tools. By leveraging the LLM's semantic understanding capabilities and integrating structural dependencies, Semref enhances both the accuracy and the comprehension of recovered architectures. To evaluate Semref, we tested on 9 projects with published ground-truth architectures and 10 state-of-the-art architecture recovery tools. 5 commonly used metrics are adopted to evaluate the effectiveness of Semref. The results show that Semref improves accuracy across various metrics, with normalized gains ranges from 17.72\% to 43.35\%. Specifically, for MoJoFM and $a2a_{adj}$ metrics, Semref achieves relative improvements of 118.57\% and 100.41\%, respectively.
Tsinghua AI