Search papers, labs, and topics across Lattice.
This paper introduces CanonNav, a visual navigation framework that disentangles navigation behavior from camera geometry, addressing the challenges of learning from cross-platform demonstrations. By implementing camera geometry canonicalization, the framework transforms visual observations into a consistent representation, allowing for effective learning without the entanglement of platform-specific camera characteristics. The results demonstrate that CanonNav outperforms both RGB-based and RGB-D-based methods in diverse environments, showcasing its robustness and effectiveness in visual navigation tasks.
CanonNav consistently outperforms traditional RGB-D methods by disentangling navigation behavior from camera geometry, enabling safer and more effective visual navigation across platforms.
While visual navigation has advanced through imitation learning from cross-platform demonstrations, fully leveraging such data remains challenging. First, directly learning from image-trajectory pairs entangles navigation behavior with platform-dependent camera geometry. This hinders consistent learning by forcing the policy to implicitly infer camera geometry from visual observations, an inherently ill-posed problem. Second, imitation learning from demonstrated trajectories captures the expert's chosen motion but leaves the intermediate decisions underlying that motion implicit. To address these issues, we propose CanonNav, a visual navigation framework that disentangles navigation behavior from camera geometry and incorporates complementary planning supervision into learning from cross-platform demonstrations. CanonNav introduces camera geometry canonicalization, which transforms visual observations and trajectories into a camera-consistent representation space. Building on this representation, we derive safety and local-progress supervision using pseudo-labels from an offline traversability estimator. Safety supervision penalizes unsafe trajectories, while local-progress supervision guides where the robot should advance. Experiments across diverse camera configurations and environments show that, despite using only RGB at inference, CanonNav consistently outperforms RGB-based baselines and even surpasses RGB-D-based methods in challenging scenarios.
