Search papers, labs, and topics across Lattice.
The paper introduces CHOP, a method for improving visuomotor navigation policies by fine-tuning them with counterfactual human preference labels on navigation trajectories, including the robot's executed trajectory and alternative trajectories. Human annotators provide pairwise preferences based on collision risk and path efficiency, which are then aggregated to align the policies with human intuition of safety. Experiments on the SCAND dataset and real-world deployments on a Ghost Robotics Vision60 quadruped demonstrate that CHOP significantly reduces near-collision events, improves obstacle clearance, and increases goal success rates compared to pretrained baselines.
Counterfactual human preference labels dramatically improve robot navigation safety, reducing collisions by nearly 50% in simulation and boosting real-world goal success by 24%.
Visuomotor navigation policies have shown strong perception-action coupling for embodied agents, yet they often struggle with safe navigation and dynamic obstacle avoidance in complex real-world environments. We introduce CHOP, a novel approach that leverages Counterfactual Human Preference Labels to align visuomotor navigation policies towards human intuition of safety and obstacle avoidance in navigation. In CHOP, for each visual observation, the robot's executed trajectory is included among a set of counterfactual navigation trajectories: alternative trajectories the robot could have followed under identical conditions. Human annotators provide pairwise preference labels over these trajectories based on anticipated outcomes such as collision risk and path efficiency. These aggregated preferences are then used to fine-tune visuomotor navigation policies, aligning their behavior with human preferences in navigation. Experiments on the SCAND dataset show that visuomotor navigation policies fine-tuned with CHOP reduce near-collision events by 49.7%, decrease deviation from human-preferred trajectories by 45.0%, and increase average obstacle clearance by 19.8% on average across multiple state-of-the-art models, compared to their pretrained baselines. These improvements transfer to real-world deployments on a Ghost Robotics Vision60 quadruped, where CHOP-aligned policies improve average goal success rates by 24.4%, increase minimum obstacle clearance by 6.8%, reduce collision and intervention events by 45.7%, and improve normalized path completion by 38.6% on average across navigation scenarios, compared to their pretrained baselines. Our results highlight the value of counterfactual preference supervision in bridging the gap between large-scale visuomotor policies and human-aligned, safety-aware embodied navigation.
