Search papers, labs, and topics across Lattice.
AlphaCNOT, a novel reinforcement learning framework, tackles the CNOT minimization problem in quantum circuit optimization by framing it as a model-based planning task using Monte Carlo Tree Search (MCTS). Unlike previous RL approaches, AlphaCNOT leverages lookahead search to evaluate future CNOT sequences, leading to more efficient optimization. Experiments demonstrate a 32% reduction in CNOT gate count compared to the Patel-Markov-Hayes (PMH) algorithm for linear reversible synthesis and consistent gate count reduction on various topologies compared to state-of-the-art RL methods.
Model-based reinforcement learning slashes CNOT gate count in quantum circuits by up to 32%, outperforming heuristic and model-free RL methods.
Quantum circuit optimization is a central task in Quantum Computing, as current Noisy Intermediate Scale Quantum devices suffer from error propagation that often scales with the number of operations. Among quantum operations, the CNOT gate is of fundamental importance, being the only 2-qubit gate in the universal Clifford+T set. The problem of CNOT gates minimization has been addressed by heuristic algorithms such as the well-known Patel-Markov-Hayes (PMH) for linear reversible synthesis (i.e., CNOT minimization with no topological constraints), and more recently by Reinforcement Learning (RL) based strategies in the more complex case of topology-aware synthesis, where each CNOT can act on a subset of all qubits pairs. In this work we introduce AlphaCNOT, a RL framework based on Monte Carlo Tree Search (MCTS) that address effectively the CNOT minimization problem by modeling it as a planning problem. In contrast to other RL- based solution, our method is model-based, i.e. it can leverage lookahead search to evaluate future trajectories, thus finding more efficient sequences of CNOTs. Our method achieves a reduction of up to 32% in CNOT gate count compared to PMH baseline on linear reversible synthesis, while in the constraint version we report a consistent gate count reduction on a variety of topologies with up to 8 qubits, with respect to state-of-the-art RL-based solutions. Our results suggest the combination of RL with search-based strategies can be applied to different circuit optimization tasks, such as Clifford minimization, thus fostering the transition toward the "quantum utility" era.
