Search papers, labs, and topics across Lattice.
This paper introduces a deep reinforcement learning (DRL) framework using Double Deep-Q Networks (DDQN) to automate the design of quantum circuits for Variational Imaginary Time Evolution (VITE). The DRL agent optimizes for both energy expectation values and circuit complexity, addressing limitations of manually designed ansatz on NISQ devices. Results show the agent autonomously discovers circuits with significantly reduced gate counts and depth compared to standard hardware-efficient ansatz in Max-Cut problems and achieves the Full-CI limit for molecular hydrogen with shallower circuits.
DRL can autonomously discover quantum circuits for imaginary time evolution with 37% fewer gates and 43% less depth than standard approaches, hinting at non-intuitive, hardware-efficient algorithm designs.
Efficient ground state search is fundamental to advancing combinatorial optimization problems and quantum chemistry. While the Variational Imaginary Time Evolution (VITE) method offers a useful alternative to Variational Quantum Eigensolver (VQE), and Quantum Approximate Optimization Algorithm (QAOA), its implementation on Noisy Intermediate-Scale Quantum (NISQ) devices is severely limited by the gate counts and depth of manually designed ansatz. Here, we present an automated framework for VITE circuit design using Double Deep-Q Networks (DDQN). Our approach treats circuit construction as a multi-objective optimization problem, simultaneously minimizing energy expectation values and optimizing circuit complexity. By introducing adoptive thresholds, we demonstrate significant hardware overhead reductions. In Max-Cut problems, our agent autonomously discovered circuits with approximately 37\% fewer gates and 43\% less depth than standard hardware-efficient ansatz on average. For molecular hydrogen ($H_2$), the DDQN also achieved the Full-CI limit, with maintaining a significantly shallower circuit. These results suggest that deep reinforcement learning can be helpful to find non-intuitive, optimal circuit structures, providing a pathway toward efficient, hardware-aware quantum algorithm design.