Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the challenge of object detection in UAV videos caused by ego-motion and camera jitter. They introduce a framework that decouples target motion from camera motion using homography-based global motion compensation and a novel dual-interval motion extraction strategy to capture both short-term and long-term motion cues. By integrating these cues with a motion-guided attention module within a Feature Pyramid Network, the method achieves significant improvements over YOLOv8 on the VisDrone-VID dataset.
By disentangling camera motion from object motion, this UAV detection method achieves state-of-the-art performance without relying on computationally expensive optical flow.
Object detection from Unmanned Aerial Vehicles (UAVs) is challenged by severe ego-motion, camera jitter, and large scale variations. While modern detectors perform well on static images, their direct application to UAV video often fails, particularly for small objects in dynamic scenes. Existing motion-based methods either rely on computationally expensive optical flow or use single-interval differencing, which is sensitive to jitter and limited in capturing diverse motion patterns. We propose a vision-only motion-guided detection framework that decouples target motion from camera-induced disturbances. A homography-based Global Motion Compensation (GMC) first aligns adjacent frames. We then introduce a Dual-Interval Motion Extraction strategy that captures both short-term and long-term motion cues. To integrate these cues, a lightweight Motion-Guided Attention (MGA) module enhances feature representations within a Feature Pyramid Network. Experiments on the VisDrone-VID dataset demonstrate consistent improvements over a strong YOLOv8 baseline under severe ego-motion. Ablation studies further confirm the effectiveness of the dual-interval design and the proposed motion-guided attention mechanism.