Search papers, labs, and topics across Lattice.
This paper explores the application of knowledge distillation (KD) as a staged hybridization technique for visual quantum reinforcement learning (QRL), addressing the challenges posed by high-dimensional observations and unstable optimization. By first training a classical visual teacher and then distilling its policy behavior into compact downstream heads, the authors demonstrate that shallow variational quantum circuit (VQC) heads can effectively learn visual control tasks. The results indicate that while angle-encoded VQC heads maintain near-teacher performance, amplitude-encoded heads achieve extreme compactness but suffer from increased fragility and sensitivity to budget constraints.
Staged knowledge distillation allows quantum agents to learn complex visual tasks without the pitfalls of direct pixel-based training, achieving near-optimal performance with significantly smaller models.
Visual environments are a demanding setting for quantum reinforcement learning (QRL): high-dimensional observations, unstable RL optimisation, and constrained variational quantum circuits (VQCs) are difficult to train jointly. This paper studies knowledge distillation (KD) as a staged hybridisation strategy for visual QRL. Instead of training a hybrid visual agent end-to-end from pixels, we first train a classical visual teacher, freeze its encoder as a feature interface, and distil the teacher's policy behaviour into compact downstream heads. These heads can be classical or VQC-based, enabling small quantum-compatible students to be evaluated under the same frozen representation as compact classical controls. We evaluate the pipeline on CartPole Pixels and Acrobot Pixels. The results show that staged KD enables shallow VQC heads to acquire non-trivial visual-control behaviour in settings where direct pixel-based training would be substantially more difficult. Angle-encoded VQC heads retain near-teacher performance, while amplitude-encoded heads push compactness to an extreme regime, at the cost of greater fragility, stronger budget sensitivity, and higher simulation time. Overall, staged KD reframes visual QRL as a compact-head learning problem, opening a practical route for training small quantum-compatible policies outside the standard end-to-end RL loop.
