Search papers, labs, and topics across Lattice.
This paper introduces a real-time oriented object detection transformer (O2-DETR) tailored for remote sensing images, addressing the challenges of detecting objects at arbitrary angles. The approach uses angle distribution refinement to represent angle uncertainty, incorporates Chamfer distance into bipartite matching for better geometric alignment, and employs oriented contrastive denoising to stabilize training. Experiments on DOTA1.0 demonstrate that the proposed O2-DFINE-L, O2-RTDETR-R50 and O2-DEIM-R50 achieve 77.73%/78.45%/80.15% AP50 and 132/119/119 FPS on a 2080ti GPU, respectively, establishing a new state-of-the-art for real-time oriented object detection.
Achieve real-time oriented object detection in remote sensing images with a new transformer architecture that overcomes challenges in angle representation and training stability, reaching up to 80.15% AP50 at 119 FPS.
Recent real-time detection transformers have gained popularity due to their simplicity and efficiency. However, these detectors do not explicitly model object rotation, especially in remote sensing imagery where objects appear at arbitrary angles, leading to challenges in angle representation, matching cost, and training stability. In this paper, we propose a real-time oriented object detection transformer, the first real-time end-to-end oriented object detector to the best of our knowledge, that addresses the above issues. Specifically, angle distribution refinement is proposed to reformulate angle regression as an iterative refinement of probability distributions, thereby capturing the uncertainty of object rotation and providing a more fine-grained angle representation. Then, we incorporate a Chamfer distance cost into bipartite matching, measuring box distance via vertex sets, enabling more accurate geometric alignment and eliminating ambiguous matches. Moreover, we propose oriented contrastive denoising to stabilize training and analyze four noise modes. We observe that a ground truth can be assigned to different index queries across different decoder layers, and analyze this issue using the proposed instability metric. We design a series of model variants and experiments to validate the proposed method. Notably, our O2-DFINE-L, O2-RTDETR-R50 and O2-DEIM-R50 achieve 77.73%/78.45%/80.15% AP50 on DOTA1.0 and 132/119/119 FPS on the 2080ti GPU. Code is available at https://github.com/wokaikaixinxin/ai4rs.
