Track the frontier, from condensed matter to cosmology.
Search papers, labs, and topics across Lattice.
This study showcases the ability of a Unitree G1 humanoid robot to perform complex manipulation tasks using only onboard proprioception, without relying on external sensors such as cameras or tactile feedback. The trained policies demonstrate effective capabilities in diverse tasks, including bipedal walking, soccer ball trapping, and suitcase lifting, by leveraging the evolution of joint encoder readouts during compliant contact. The findings reveal that joint encoder-based proprioception can serve as a robust foundation for dexterous manipulation, suggesting that minimal sensing can yield significant interactive perception capabilities in robotics.
Robots can achieve impressive manipulation skills using only proprioception, revealing the untapped potential of joint encoder signals in dexterous tasks.
We present blind, whole-body manipulation skills on a Unitree G1 humanoid using only onboard proprioception, without cameras, markers, force-torque, or tactile sensors. Despite this minimal sensing, the trained policies exhibit surprising capability across qualitatively different tasks: push-resilient bipedal walking without IMU feedback, active soccer ball trapping with a foot, seeking and lifting a suitcase by its handle, and mounting a randomly positioned skateboard. We argue that these capabilities arise from a key underappreciated signal: the way the joint encoder readouts evolve under purposeful compliant contact, effectively forming a whole-body tactile channel. By generating contact-rich motions, the trained policies actively probe the environment; as a result, task-relevant object state (e.g., pose) becomes increasingly decodable from short proprioceptive histories. We expose this information using compact task-specific state estimators trained alongside, but fully separately from, the policies; their prediction errors decrease rapidly after informative contact. Our results indicate that joint encoder-based proprioception, combined with compliant actuation (now widely available on commercial robots and low-cost motors) is already a strong, practical substrate for whole-body dexterous manipulation and interactive perception, and therefore a natural foundation on which richer sensing can be layered.