Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
CoCam4D addresses camera-only autonomous driving perception limitations by introducing a Bayesian framework for cooperative perception that explicitly models geometric uncertainty. This framework leverages a VGGT-based network to generate 3D Gaussian scene representations with uncertainty, allowing agents to fuse observations and reduce depth uncertainty without LiDAR. Experimental results demonstrate significant performance gains over existing vision-only methods on benchmark datasets, highlighting the efficacy of geometrically grounded collaborative perception.
LiDAR-free autonomous driving is now achievable with cooperative agents sharing compact, uncertainty-aware 3D Gaussian scene primitives, significantly improving depth estimation.
Autonomous vehicles often suffer from limited perception due to occlusions, blind spots, limited sensor range, and the complex nature of surrounding environments. Multi-agent collaborative perception (CP) addresses these challenges by allowing vehicles to share sensory information and reconstruct the scene cooperatively. However, camera-only perception remains fundamentally limited by the uncertainty of distance-dependent monocular depth estimation. We propose CoCam4D, a Bayesian framework for collaborative perception that explicitly models geometric uncertainty. It uses a VGGT-based feedforward network to generate 3D Gaussian scene representations with associated uncertainty estimates, enabling multiple vehicles or agents to efficiently combine their observations. By sharing compact Gaussian primitives, reliable observations from one agent can reduce the depth uncertainty of another without requiring LiDAR sensors. To support real-world deployment, we introduce Dynamic Object Primitives (DOPs), a compact 35-byte representation designed for efficient C-V2X communication. Extensive experiments show that our proposed method consistently outperforms recent vision-only methods, achieving improvements of 11.48% on OPV2V+ and 10.62% on DAIR-V2X-C, demonstrating the potential of geometrically grounded collaborative perception for LiDAR-free autonomous driving.