Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces an energy-aware reinforcement learning framework for the Unitree G1 humanoid robot's left arm, utilizing a physics-based electrical power model and a Soft Actor-Critic (SAC) policy. The framework was trained in a Pinocchio-based simulator, achieving a 69.9% success rate for reaching tasks while minimizing energy consumption to an average of 98.16 joules. Validation on the physical robot confirmed the approach's effectiveness, with performance metrics within the training tolerance, marking a significant advancement in energy-efficient robotic manipulation.
Achieving a 69.9% success rate in energy-efficient arm reaching, this framework sets a new benchmark for humanoid robots operating under strict energy constraints.
Humanoid robots performing in-field manipulation tasks, such as robotic apple harvesting, face severe energy constraints that directly limit the number of reaching motions that can be executed per battery charge. This paper presents an end-to-end, energy-aware reinforcement learning framework for the 7-degree-of-freedom left arm of the Unitree~G1 humanoid robot, combining a physics-based, experimentally identified electrical power model with a Soft Actor-Critic (SAC) policy trained in a Pinocchio-based rigid-body dynamics simulator. The RL policy operates on an incremental joint-position action space and is trained with a Hybrid Constellation Reward that combines a four-point end-effector constellation distance with a torque-norm energy proxy; after % $5\times10^6$ training it reaches a $69.9\%$ success rate over $1\,000$ random targets in kinematic simulation, at a mean energy of \SI{98.16}{\joule} on successful episodes. Finally, on the physical Unitree~G1, the policy is validated over three independent 10-target batches, achieving a mean energy of $71.5 \pm 48.3$\,J, an end-effector position error of $2.64 \pm 1.04$\,cm, and an orientation error of $6.92 \pm 1.33^\circ$ -- within the \SI{4}{\centi\metre}/$8.6^\circ$ training tolerance. These results constitute a first step toward energy-aware reinforcement-learning-based arm reaching for humanoid robots.