Search papers, labs, and topics across Lattice.
GROVE is a novel text-to-scenario pedestrian simulation framework that enables the generation of realistic and socially complex environments for training social robots. By allowing users to customize scenarios through presets or independent prompts, GROVE effectively narrows the simulation-to-real gap by integrating state-of-the-art modules that capture nuanced pedestrian behaviors across different time horizons. Validation against existing baselines demonstrates that GROVE produces high-fidelity simulations that significantly enhance the challenges faced by social robots in diverse settings such as residential, hospital, and office environments.
GROVE transforms pedestrian simulation by enabling customizable, realistic scenarios that challenge social robots in ways traditional methods cannot.
Pedestrian simulation is a critical component for training and deploying social robot navigation approaches, yet it remains a largely rigid system that repeatedly requires manual data generation to define even simple scenarios. We propose GROVE, a text-to-scenario pedestrian simulation framework that combines state-of-the-art approaches to produce realistic, socially challenging scenarios for social robot navigation. Our framework allows users to customize one of several common presets (emergency, queuing, normal) or even enter a fully independent prompt to generate a highly customizable pedestrian simulation. Multiple modules separately ensure the realism and soundness of long-horizon human behavior, medium-horizon pedestrian navigation, and short-horizon robot/social interactions. Each module is tuned by the prompt in a way that reflects the user intent across all aspects of pedestrian simulation. By dynamically selecting one of several state-of-the-art (SotA) approaches in our modules based on the scenario, we capture many situational nuances of pedestrian behavior in order to narrow the simulation-to-real (sim2real) gap. The human simulation is directly integrated into Isaac Sim, Gazebo, and RViz simulators for robot deployment in highly social environments. We validate our approach through qualitative comparison against existing pedestrian simulation baselines across scenarios of varying complexity in residential, hospital, and office environments. The result is a high-fidelity pedestrian simulation that challenges social robot navigation with complex, diverse, realistic human behaviors.
NUS