Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a geometry-driven framework for opti-acoustic co-registration and view-invariant reflectivity mapping in side-scan sonar applications, addressing the challenges posed by acoustic complexities such as speckle noise and viewpoint dependencies. By leveraging Structure-from-Motion (SfM) to create a dense 3D seafloor mesh, the method effectively bridges the gap between optical and acoustic imagery, while a novel First Bottom Return (FBR) extraction algorithm corrects altitude drift. The resulting pipeline produces highly accurate, co-registered multi-modal datasets, significantly enhancing automated underwater mapping capabilities without the need for manual annotation.
Automated underwater mapping just got a major upgrade with a geometry-driven approach that eliminates manual annotation and achieves high accuracy in co-registering optical and acoustic data.
Side-Scan Sonar (SSS) is a primary modality for large-scale underwater mapping, yet automated perception and cross-modal alignment are severely bottlenecked by acoustic complexities such as speckle noise, shadows, and extreme viewpoint dependencies. Traditional handcrafted descriptors and modern deep learning matchers fail to bridge the physical domain gap between optical and acoustic imagery without 3D geometric constraints. To overcome these limitations, we propose a novel geometry-driven framework for pixel-level opti-acoustic co-registration and view-invariant reflectivity mapping. Our method utilizes Structure-from-Motion (SfM) to reconstruct a dense 3D seafloor mesh, acting as a geometric anchor between the visual and acoustic domains. We introduce a First Bottom Return (FBR) extraction algorithm to dynamically correct non-linear altitude drift caused by uncalibrated SfM reconstruction. Furthermore, we apply an inverse Lambertian model and a dual-Gaussian weighting function to isolate the intrinsic seabed reflectivity, effectively neutralizing slant-range propagation loss and geometric view-dependence. By deterministically associating these isolated acoustic properties with optical pixels, our pipeline generates highly accurate, strictly co-registered multi-modal datasets. This automated, physics-guided approach eliminates the need for manual annotation and paves the way for advanced self-supervised learning in benthic habitat mapping.