Search papers, labs, and topics across Lattice.
This paper conducts the first systematic empirical study on migrating GUI test cases from Android to OpenHarmony, addressing a significant gap in existing research. By constructing the ATH Benchmark dataset and evaluating two state-of-the-art migration approaches, ReSPlay and ITeM, the authors find that these methods yield low success rates of 15% and 26%, respectively, due to OpenHarmony's unique characteristics. To improve migration efficacy, they propose an enhanced method, ITeM-HM, which achieves a remarkable 214% increase in success rate, elevating it to 81% by incorporating OpenHarmony-specific features.
Existing test migration methods falter in OpenHarmony, but a new approach boosts success rates from 26% to 81% by leveraging system-specific insights.
To reduce the substantial engineering effort required to test the corresponding applications from Android to OpenHarmony, migrating existing GUI test cases has become a critical problem. However, current research neither proposes solutions tailored for OpenHarmony nor provides a systematic evaluation of migration approaches on this system, leaving developers with limited empirical guidance in practice. In this paper, we present the first systematic empirical study of test migration from Android to OpenHarmony. Specifically, we first construct a dataset referred to as the ATH Benchmark, comprising 36 commercial applications with an average of over 9 billion downloads, along with 108 manually designed test cases. Second, we select two state-of-the-art test migration approaches (i.e., ReSPlay and ITeM) and adapt these two approaches to enable their execution on OpenHarmony. Third, we use the preceding infrastructure to evaluate these two approaches from three perspectives, including testing performance, root causes of failures, and the impact of OpenHarmony characteristics. Our results reveal that existing test migration approaches are less effective (15% success-rate on ReSPlay and 26% success-rate on ITeM) in Android-to-OpenHarmony scenarios. Through an in-depth analysis of failed cases, we identify that test performance is primarily hindered by OpenHarmony-specific characteristics, including technical architecture differences and unique ecosystem traits. Utilizing these findings, we propose an enhanced approach based on ITeM, referred as ITeM-HM, which incorporates specific OpenHarmony system features. As a result, ITeM-HM successfully achieves a 214% success-rate relative improvement over the original ITeM (from 26% to 81%).
