Search papers, labs, and topics across Lattice.
PanoDP, a novel learning framework, tackles autonomous navigation in cluttered environments by integrating four-view panoramic depth perception with differentiable physics. The framework uses a lightweight CNN to encode panoramic depth and optimizes policies using dense differentiable collision and motion-feasibility terms, enhancing training stability. Experiments demonstrate that PanoDP outperforms single-view and non-physics-guided baselines in collision-free and completion rates across various simulated environments, including out-of-distribution generalization tests in AirSim.
Panoramic depth perception and differentiable physics unlock surprisingly robust collision avoidance, even generalizing to unseen simulation environments.
Autonomous collision-free navigation in cluttered environments requires safe decision-making under partial observability with both static structure and dynamic obstacles. We present \textbf{PanoDP}, a communication-free learning framework that combines four-view panoramic depth perception with differentiable-physics-based training signals. PanoDP encodes panoramic depth using a lightweight CNN and optimizes policies with dense differentiable collision and motion-feasibility terms, improving training stability beyond sparse terminal collisions. We evaluate PanoDP on a controlled ring-to-center benchmark with systematic sweeps over agent count, obstacle density/layout, and dynamic behaviors, and further test out-of-distribution generalization in an external simulator (e.g., AirSim). Across settings, PanoDP increases collision-free and completion rates over single-view and non-physics-guided baselines under matched training budgets, and ablations (view masking, rotation augmentation) confirm the policy leverages 360-degree information. Code will be open source upon acceptance.
