Search papers, labs, and topics across Lattice.
The authors introduce WildDepth, a new multimodal dataset containing synchronized RGB and LiDAR data for diverse animal species in both domestic and wild settings, designed to address the lack of metrically scaled animal datasets for depth estimation. Experiments demonstrate that incorporating LiDAR data improves depth estimation accuracy by 10% RMSE and 3D reconstruction fidelity by 12% in Chamfer distance compared to RGB-only approaches. The release of WildDepth aims to promote the development of robust multimodal perception systems applicable across different environments.
LiDAR data boosts animal depth estimation accuracy by 10% RMSE, revealing the power of multimodal data for 3D wildlife perception.
Depth estimation and 3D reconstruction have been extensively studied as core topics in computer vision. Starting from rigid objects with relatively simple geometric shapes, such as vehicles, the research has expanded to address general objects, including challenging deformable objects, such as humans and animals. However, for the animal, in particular, the majority of existing models are trained based on datasets without metric scale, which can help validate image-only models. To address this limitation, we present WildDepth, a multimodal dataset and benchmark suite for depth estimation, behavior detection, and 3D reconstruction from diverse categories of animals ranging from domestic to wild environments with synchronized RGB and LiDAR. Experimental results show that the use of multi-modal data improves depth reliability by up to 10% RMSE, while RGB-LiDAR fusion enhances 3D reconstruction fidelity by 12% in Chamfer distance. By releasing WildDepth and its benchmarks, we aim to foster robust multimodal perception systems that generalize across domains.
