Search papers, labs, and topics across Lattice.
This paper introduces VIPS, a benchmark designed for evaluating cooperative autonomous driving in Vehicle-to-Infrastructure (V2I) contexts using pseudo-simulation, which integrates observations from both vehicles and infrastructure. The significance of this work lies in its ability to provide a scalable and realistic evaluation framework that addresses the limitations of existing open-loop and closed-loop evaluation methods, particularly in terms of error propagation and recovery. The key result is the development of CoS-V2X, a cooperative planning framework that utilizes sparse representations for efficient communication and robust decision-making amidst complex multi-agent interactions in urban environments.
VIPS reveals that integrating vehicle and infrastructure observations can significantly enhance the robustness of autonomous driving evaluations without the pitfalls of traditional simulation methods.
End-to-end autonomous driving in urban environments requires robust decision-making under partial observability and complex multi-agent interactions. Severe occlusions and dense traffic at intersections limit the perception capability of single-agent systems, motivating recent efforts on Vehicle-to-Infrastructure (V2I) cooperation for perception and planning. However, existing evaluation protocols face a fundamental trade-off: open-loop evaluation fails to capture error accumulation and recovery from deviations, while closed-loop evaluation is costly, difficult to scale, and often relies on simulated environments that may suffer from domain gaps. To bridge this gap, we propose VIPS, a benchmark for cooperative autonomous driving in V2I settings based on pseudo-simulation. VIPS extends pseudo-simulation by integrating vehicle and infrastructure observations. This enables scalable yet realistic evaluation of robustness and error propagation without full simulation. We further present CoS-V2X, a cooperative planning framework based on sparse representations. CoS-V2X models vehicle-infrastructure interactions using compact features for efficient communication and robust decision-making under heterogeneous observations. Code and dataset are available at https://vips2026.github.io.
