Search papers, labs, and topics across Lattice.
This paper introduces NavIsaacLab, a novel framework designed for benchmarking and training human-aware navigation policies through realistic simulations of pedestrian behavior and environments. By leveraging physics-based rendering and parallel GPU simulations, the framework provides real-time, high-fidelity 3D visual feedback, addressing the limitations of existing simulation platforms that rely on simplistic, handcrafted models. The integration of a trajectory diffusion model and adversarial motion learning enhances the realism of pedestrian simulations, resulting in a robust benchmark for evaluating advanced navigation algorithms.
Realistic pedestrian simulations can significantly improve the training and evaluation of human-aware navigation systems, bridging the gap between simulated and real-world interactions.
Robot autonomous navigation that accounts for surrounding human activities is crucial for ensuring both safety and natural human-robot interaction in real-world environments shared by humans and robots. Simulation of complex and diverse navigation scenarios serves as the foundation for training reliable robot navigation policies and accurately evaluating the performance of algorithms, offering an efficient alternative to manual supervision of real data. However, current human-aware navigation research faces significant challenges due to the scarcity of diverse, high-quality scene data. Existing simulation platforms often rely on handcrafted rules to approximate pedestrian behavior and lack the capability to provide extensive sensor signals, typically assuming perfect observations. To address these limitations, this paper presents NavIsaacLab, a comprehensive framework for benchmarking and training human-aware navigation policies through physics-based and photo-realistic simulations of pedestrians and scenes. Based on Isaac Lab, the proposed framework employs photo-realistic scene rendering capabilities and supports parallel simulation on GPU, delivering real-time and accurate 3D visual feedback to robots. To enhance the realism of human behavior, a data-driven approach is employed that incorporates a trajectory diffusion model and an adversarial motion learning controller, enabling controllable, physics-based pedestrian simulation. Furthermore, the integration of diverse cross-scale scenes provides a robust benchmark for state-of-the-art human-aware navigation methods.
