Search papers, labs, and topics across Lattice.
This paper introduces a modular dual-camera pipeline for aerial micro-inspection that enhances the capabilities of drone-based inspections by utilizing a gimbal-mounted zoom camera for fine detail capture and a wide-field stereo navigation camera for effective target localization. The approach mitigates challenges such as drone disturbances and the need for prior target information, allowing for robust inspections of non-structural targets like trees and vehicles. Evaluation results demonstrate improved coverage and successful detection of pests in real-world scenarios, showcasing the pipeline's adaptability and effectiveness in various inspection contexts.
A dual-camera system enables drones to inspect targets from a safe distance while maintaining high detail and accuracy, revolutionizing aerial inspections.
Most existing drone-based inspection systems require the drone to fly dangerously close to the target or follow complex flight paths to capture small details. In addition, drone flight is affected by disturbances and localization inaccuracies, which can cause the drone to lose sight of its supposed target when it has a narrow view. Furthermore, trajectory planning often requires prior information about the target's geometry, position, and orientation, which is not always available for non-structural targets such as trees, vehicles, or people. To address these challenges, this paper presents aerial_micro_inspection, a generic pipeline for aerial micro-inspection across different use cases. The pipeline assumes a PX4-powered drone equipped with two cameras: (i) a zoomed, gimbal-mounted inspection camera that captures fine details without requiring the drone to fly very close to the target, and (ii) a wide-field-of-view stereo navigation camera that acquires the target surface on site, estimates its range, and partitions it into smaller inspection regions. In addition, a vision-based feedback loop compensates for drone motion while the inspection camera visits small partitions of a larger surface. We evaluate the pipeline in simulation and real-world experiments, mainly in two use-case scenarios: tree inspection for detecting oak processionary caterpillars and their eggs, and greenhouse inspection of sticky traps for detecting whiteflies. The results show improved coverage robustness under drone disturbances in simulation, as well as effective detection of caterpillars and eggs and high-detail imaging of insects in real-world experiments. The pipeline is open-source, developed in ROS 2, and can be adapted to new applications by replacing the surface-segmentation and micro-target detection checkpoints. The code is available at: https://github.com/SaxionMechatronics/aerial_micro_inspection