Search papers, labs, and topics across Lattice.
This paper introduces six quantum-tailored coverage criteria (condition, decision, path, and their probabilistic variants) for assessing test adequacy in circuit-based quantum programs. The authors developed QaCoCo, a tool to compute these criteria, and evaluated them on 540 diverse quantum circuits. Results show high condition and decision coverage but limited path coverage, especially with multi-controlled gates, and weak correlation between structural coverage and fault detection, mirroring classical computing observations.
Quantum programs can achieve seemingly high structural coverage, yet this bears little relation to their actual fault detection capability, echoing a cautionary tale from classical software testing.
Coverage criteria play a central role in assessing test adequacy in classical software, yet their effectiveness for quantum programs remains poorly understood and largely unexplored. In this paper, we propose six quantum-tailored criteria - condition, decision, and path coverage, and their probabilistic variants - adapted from their classical counterparts. We present QaCoCo, a tool that computes these criteria for circuit-based quantum programs. We empirically evaluate these criteria on a large and diverse set of 540 circuits and analyze the coverage achieved. Our results show that while circuits frequently achieve high condition and decision coverage (97.56% and 97.63%, on average), path coverage remains limited (71.84%), particularly in the presence of multi-controlled gates, which induce extreme path explosion and coverage imbalance. Moreover, to account for the probabilistic nature of quantum circuits, we introduce probabilistic coverage, which augments structural coverage with a confidence measure (88.87%, 88.65%, and 37.18% for condition, decision, and path coverage, respectively, on average). Finally, through mutation testing, we find weak or no correlation between fault detection and structural coverage, consistent with observations in classical computing.
