Search papers, labs, and topics across Lattice.
RoboRacer Arena introduces a novel system that generates high-fidelity 3D racing environments from occupancy maps, addressing the limitations of existing simulators that either lack physical contact or require extensive manual asset creation. By employing a flood fill algorithm to delineate drivable corridors and collision boundaries, the platform automates the creation of diverse racing tracks, including those derived from natural language descriptions. In benchmark tests, the system demonstrated impressive performance, achieving 8,707 vehicle-steps per second with 256 parallel vehicles, while maintaining a robust validation rate across 21 generated maps.
Generating 3D racing environments from natural language descriptions could revolutionize how we create and scale autonomous vehicle simulations.
RoboRacer offers a standardized platform for research using 1:10-scale autonomous vehicles, but the variety of available tracks hinders the process of acquiring policies. Although existing occupancy-grid simulators allow for the quick addition of new maps, they fail to include physical contact, while 3D simulators require each circuit to be implemented as a separate asset, thus limiting their scalability. In order to overcome this issue, we have developed RoboRacer Arena, a system that creates 3D racing environments directly from occupancy maps. Our method starts by using a flood fill algorithm to extract the drivable corridors and to identify the track boundaries, which are then used to establish the barriers. A distance field is calculated to define the collision boundaries. The track surfaces, collision properties, and materials are assembled into a USD stage, which allows for the automated and reproducible generation of the environment in Isaac Sim. The input maps can be obtained from SLAM sessions, from rescaled Formula 1 circuits, or from natural-language descriptions. When the input is based on natural language, we use Gemma 4 31B to generate a track specification without specifying any coordinates or geometry. To guarantee consistency and reproducibility, we apply geometric screening, procedural generation, and raster-level validation. The simulation environments are initialized in a time range of 1.18 to 2.48 seconds, with the initialization time increasing linearly as the raster size increases. In 30 matched trials involving 10 tracks and 3 seeds, 21 maps were generated and all passed validation. RoboRacer Arena currently contains 130 tracks and supports the generation of tracks from natural language. In benchmark tests, the system attains 8,707 vehicle-steps per second when using 256 parallel rigid-body vehicles, excluding the time taken for rendering and policy execution.
