Search papers, labs, and topics across Lattice.
This paper introduces a hierarchical reinforcement learning framework, VGPA, designed to enhance strawberry harvesting in clustered environments where ripe fruits are often obscured by unripe ones. By decomposing the task into obstacle separation and target grasping, the framework leverages a vision-guided decision mechanism for improved option selection and a Progressive Adaptive Exploration Strategy (PAES) for better exploration efficiency. The approach achieved a 96.7% success rate in simulations and demonstrated strong real-world performance, with success rates between 71.7% and 88.3% on a parallel robot, significantly outperforming traditional methods.
Achieving a 96.7% success rate in simulating complex strawberry harvesting tasks reveals the potential of hierarchical reinforcement learning in real-world agricultural robotics.
Selective harvesting in clustered strawberry environments is challenging because ripe fruits are often occluded by surrounding unripe fruits, making direct grasping unreliable. To address this problem, this paper proposes a hierarchical reinforcement learning framework, termed VGPA, which integrates a vision-guided decision mechanism and a Progressive Adaptive Exploration Strategy (PAES) for vision-based obstacle separation and harvesting. The task was decomposed into two sequential stages: obstacle separation and target grasping. At the high level, the vision-guided mechanism improved option selection and accelerated policy convergence. At the low level, PAES improved exploration efficiency and training stability during continuous control learning. In simulation experiments, the learned policy achieved a success rate of 96.7%. In addition, sim-to-real transfer experiments on a self-developed parallel robot showed that the proposed method achieved success rates ranging from 71.7% to 88.3%, outperforming direct picking while requiring only 1.22~s more average harvesting time. These results verified the effectiveness, generalization ability, and practical potential of the proposed method for robotic harvesting in complex clustered environments.