Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a novel approach for metamorphic testing (MT) of query-based systems (QBSs) that leverages input relation prompting to identify metamorphic relations (MRs) without relying on exhaustive domain knowledge or predefined test cases. By enabling testers to generate MRs that describe the relationships between inputs and outputs, the method enhances fault detection when expected relationships are violated, addressing the oracle problem inherent in QBS testing. A case study on a real-world web application validates the approach's effectiveness and highlights its potential to improve testing efficiency in practical scenarios.
Testers can now automatically generate metamorphic relations for query-based systems, significantly enhancing fault detection without needing exhaustive domain knowledge.
Testing query-based systems (QBSs) presents significant challenges due to the absence of ground truth for validation and the extensive time and effort required for manual testing. This paper addresses these challenges by proposing an approach that assists testers in identifying metamorphic relations (MRs) for metamorphic testing (MT) instead of solely and exhaustively relying on prerequisite domain knowledge. MT is an approach rising in popularity employed to alleviate the oracle problem by applying input transformation rules (MRs) to a program. The proposed approach helps the tester by prompting MRs that describe the relationships between inputs and outputs, enabling fault detection when the expected relationship is not met. Unlike traditional testing approaches, this approach does not rely on pre-defined test cases or concrete ground truth, making it suitable for the testing of real-world QBSs. Furthermore, the proposed approach can be combined with other testing methods such as combinatorial testing and fuzz testing, expanding the possibilities for QBS testing. A conducted case study of a real-world web application demonstrates the applicability and potential of the proposed approach. Overall, this research contributes to advancing the field of metamorphic testing and provides a valuable tool for QBS testers to enhance their testing efficiency.