Search papers, labs, and topics across Lattice.
This study investigates the effectiveness of training-free feature-space methods for detecting annotation errors in object detection datasets, addressing a critical gap in the analysis of complex visual tasks. The researchers adapted an existing feature-space approach and demonstrated its ability to reliably identify semantic mislabels, although it struggled with positional errors. Evaluations were conducted using various pretrained embedding models and both synthetic and real-world datasets, revealing significant insights into the limitations and strengths of current methods for error detection in object annotations.
Training-free methods can effectively uncover semantic mislabels in object detection datasets, but struggle with positional inaccuracies.
Annotation errors are widespread in computer vision datasets and can significantly degrade the performance of systems trained on them, particularly in complex tasks such as object detection. Several approaches exist to identify annotation errors, including training-free feature-space methods which provide a fast and interpretable way to analyze annotations. However, the behavior on object detection annotations, which include semantic and spatial information, remains largely unexplored. In this work we analyze the applicability of feature-space-based approaches for detecting annotation errors in object detection datasets. By adapting an existing feature-space method, we show that such approaches reliably expose semantic mislabel, while positional errors remain difficult to detect. We evaluate this behavior across multiple pretrained embedding models, synthetic noise types (symmetric, asymmetric, and positional), and real-world annotation errors using VOC2012 and KITTI. All code and real-world corruptions are publicly available at the following repository: https://github.com/ ChristianSieberichs/BoundingBox\_corruption\_detection
