Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a mixed-reality hardware-in-the-loop (HIL) testbed that integrates physical mobile robots with a high-fidelity simulation environment to create diverse, safety-critical driving scenarios for autonomous vehicles. By combining multimodal sensors on physical robots with virtual agents, the testbed enables rigorous validation of perception, planning, and control algorithms while supporting research on multi-agent systems. The authors also present a safety-guaranteed framework that employs Control Barrier Functions (CBFs) for real-time learning and control, demonstrating the testbed's effectiveness in bridging the gap between simulation and real-world deployment through experimental validation.
A revolutionary mixed-reality testbed that merges physical and virtual environments could redefine how we validate autonomous vehicle systems in safety-critical scenarios.
We propose a mixed-reality, hardware-in-the-loop (HIL) testbed for autonomous vehicles that seamlessly integrates a physical testbed of mobile robots with a high-fidelity simulation environment. The virtual simulation enables the creation of diverse, safety-critical driving scenarios to validate state-of-the-art perception, planning, and control algorithms, while augmenting simulations with physical robots equipped with multimodal sensors in photorealistic virtual environments further facilitating rigorous validation. Our testbed also features vehicular connectivity using wireless communication and can accommodate a large number of agents through the combination of physical robots and virtual simulated agents, supporting research on multi-agent systems including Connected and Autonomous Vehicles (CAVs). Finally, we present a safety-guaranteed framework combining perception, planning and a novel online learning-based controller using Control Barrier Functions (CBFs) for CAVs. Experiments using the proposed framework are used to validate and demonstrate the key functionalities and the overall utility of the testbed to bridge the gap between simulation and real-world hardware deployment.