Search papers, labs, and topics across Lattice.
This paper introduces an adaptive sensor fusion approach for single-vessel tracking using camera and LiDAR data, where sensor selection is driven by an entropy-reduction policy to maximize information gain. A particle filter integrates the selected sensor data, enabling robust tracking even when individual sensors experience degradation due to range, illumination, or clutter. Experiments in a real-world maritime environment demonstrate that the adaptive policy achieves a trade-off between accuracy and continuity, outperforming single-sensor and all-sensor configurations while reducing computational cost.
Smart sensor selection using entropy reduction lets a camera-LiDAR tracker achieve better accuracy and continuity than using either sensor alone, or both all the time.
Robust single-vessel tracking from fixed coastal platforms is hindered by modality-specific degradations: cameras suffer from illumination and visual clutter, while LiDAR performance drops with range and intermittent returns. We present a heterogeneous multi-sensor fusion particle-filter tracker that incorporates an information-gain (entropy-reduction) adaptive sensing policy to select the most informative configuration at each fusion time bin. The approach is validated in a real maritime deployment at the CMMI Smart Marina Testbed (Ayia Napa Marina, Cyprus), using a shore-mounted 3D LiDAR and an elevated fixed camera to track a rigid inflatable boat with onboard GNSS ground truth. We compare LiDAR-only, camera-only, all-sensors, and adaptive configurations. Results show LiDAR dominates near-field accuracy, the camera sustains longer-range coverage when LiDAR becomes unavailable, and the adaptive policy achieves a favorable accuracy-continuity trade-off by switching modalities based on information gain. By avoiding continuous multi-stream processing, the adaptive configuration provides a practical baseline for resilient and resource-aware maritime surveillance.
