Search papers, labs, and topics across Lattice.
This paper introduces MAST, a multi-agent framework designed to predict which test cases require maintenance after changes to production code, addressing the costly challenge of test maintenance in evolving codebases. By integrating static, lexical, and semantic analyses through an intelligent fusion process, MAST outperforms existing methods in precision, accuracy, and F1 and F2 scores while maintaining a realistic evaluation setting across 21 industrial Java repositories. The results highlight the effectiveness of multi-agent systems in enhancing software testing tasks by inferring relationships between test and production artifacts without relying on pre-existing mappings.
MAST achieves superior precision in predicting test maintenance needs, outperforming state-of-the-art methods while revealing the intricate relationships between production and test code.
Test maintenance is a critical, yet costly, activity - particularly as codebases rapidly evolve. To assist, we present MAST, a multi-agent framework that predicts which test cases require maintenance following changes to the production code. This identification task is necessary as a precondition to any subsequent maintenance activities, but remains challenging due to the complex relationships between production and test code. MAST advances the state-of-the-art by integrating multiple analyses -- including static, lexical, and semantic analyses - through an intelligent fusion and post-check procedure and by focusing on a realistic use and evaluation setting - i.e., standardized input formats, repository-level analyses, and the ability to infer relations between test and production artifacts rather than assuming a pre-existing mapping. We evaluated MAST on 21 industrial Java repositories from Ericsson AB, considering situations where test maintenance both was and was not required in the ground truth. MAST yielded superior precision to a state-of-the-art baseline - resulting in a higher accuracy, F1, and F2 score - with only some loss in recall. Our ablation study demonstrates the value of each analysis in producing the final recommendations. MAST illustrates the potential of multi-agent systems that can fuse multiple information sources when performing software testing tasks.
