Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper explores the challenge of humanoid robots traversing sparse 3D structures, specifically through a monkey-bar traversal task that requires agile and accurate whole-body motions. The authors develop a reinforcement-learning-based perceptive control system that utilizes a head-mounted lidar to perceive thin geometry, employing an attention-based encoder with recurrent memory to process sparse lidar data. The resulting policy successfully executes the jump-brachiation-jump sequence in 14 out of 15 trials and achieves brachiation speeds of up to 0.5 m/s, demonstrating effective real-world application and adaptability to hardware constraints.
Humanoid robots can now traverse complex 3D structures with remarkable agility and precision, completing intricate maneuvers in real-world trials.
Traversing sparse 3D structures requires humanoid robots to perceive thin, overhanging geometry while executing agile, accurate whole-body motions. We study this problem through monkey-bar traversal, where the robot must jump to the structure, traverse it through sparse bar interactions, and land safely. For this task, we present a reinforcement-learning-based perceptive control system that operates directly on observations from a head-mounted solid-state lidar. To extract task-relevant geometry from the sparse returns, the policy consumes the raw lidar scan through an attention-based encoder with recurrent memory. This policy is obtained by a phase-scheduled teacher- student pipeline that combines privileged experts for jumping up, brachiating, and jumping down. For transfer to hardware, we model lidar noise, battery-voltage sag, and actuator thermal limits, and equip the humanoid with passive hook end-effectors for robust bar interaction. On hardware, the resulting policy completes the full jump-up->brachiation->jump-down sequence in 14 of 15 trials across three bar configurations and reaches brachiation speeds up to 0.5 m/s. Beyond brachiation, the same perception backbone supports a separately trained policy that ducks beneath thin overhead obstacles with 2 cm cross-sections.