Search papers, labs, and topics across Lattice.
KQFuzz is a novel knowledge-guided fuzzing tool designed specifically for quantum libraries, addressing the limitations of existing LLM-based fuzzing methods in terms of flexibility and efficiency. By leveraging comprehensive codebase knowledge and employing a tailored prompting scheme, KQFuzz generates high-quality quantum seed programs and utilizes fitness-guided evaluation alongside two-level mutations to explore complex execution paths. Experimental results show that KQFuzz outperforms state-of-the-art methods, achieving up to 18.44% greater coverage and successfully identifying 13 bugs, 12 of which have been fixed by developers.
KQFuzz uncovers bugs in quantum libraries with 18.44% better coverage than existing methods, revealing critical flaws that developers can quickly address.
As quantum computing continually improves, ensuring the reliability and correctness of quantum libraries has become increasingly critical. To this end, many LLM-based fuzzing approaches towards quantum libraries have been proposed to uncover potential bugs. However, these methods still suffer from limitations such as insufficient flexibility and low efficiency, which hinder the progress of the quantum computing field. To address these challenges, we propose KQFuzz, a novel knowledge-guided fuzzer for quantum libraries. It leverages comprehensive codebase knowledge to ground LLM-based test generation, synergizing this with fitness-guided evaluation and two-level mutations to explore complex execution paths and trigger potential bugs. Firstly, KQFuzz introduces a novel prompting scheme tailored to quantum programs, which strategically incorporates knowledge of the codebase to efficiently generate high-quality quantum seed programs. Moreover, we develop evaluation and mutation strategies to handle the generated seed programs, facilitating efficient fuzzing execution while further enriching the diversity of the resulting test cases. We implement KQFuzz and conduct fuzzing on three popular quantum libraries, including Qiskit, PennyLane, and Cirq. Experimental results demonstrate that our approach significantly outperforms other state-of-the-art methods, with coverage improved by up to 18.44%. During the development of KQFuzz, we discovered 13 bugs, all of which have been confirmed and 12 have already been fixed by the developers.