Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces ContextShift, a novel benchmark designed to evaluate the robustness of object detectors against contextual variations while controlling for object appearance. By systematically manipulating object-context relationships through geometric transformations and background substitutions, the study reveals that false negatives can increase by up to 227% and prediction volume can decrease by 44%, highlighting significant recall loss that traditional aggregate metrics like AP fail to capture. The findings indicate that context-aware augmentation during training can enhance robustness, allowing models to better handle context shifts and recover performance lost due to prediction suppression failures.
False negatives in object detection can soar by over 200% when context changes, revealing a critical blind spot in traditional evaluation metrics.
Modern object detectors achieve strong performance on standard benchmarks, yet their robustness to contextual variation remains insufficiently understood. Prior evaluations largely rely on aggregate metrics such as AP on uncontrolled distribution shifts, which can obscure how performance degrades under context change. We introduce ContextShift, a controlled benchmark that systematically manipulates object--context relationships while preserving object appearance. Built on COCO 2017, it isolates context as an independent variable through geometric transformations and synthetic and natural background substitutions, including a continuous compatibility axis based on normalized pointwise mutual information (NPMI). Across diverse detector architectures, we observe a consistent degradation pattern: false negatives increase by up to 227% and prediction volume decreases by up to 44%, while false positives remain stable or decline. This suppression behavior is not captured by aggregate metrics such as AP, which can mask substantial recall loss and changes in prediction dynamics. Further analysis suggests that degradation is driven less by reduced confidence than by a reduced formation of valid detection candidates. Moreover, performance along the statistical compatibility axis is non-monotonic, peaking at intermediate NPMI and degrading toward both extremes, indicating that statistical co-occurrence does not correlate linearly with effective visual context. Finally, we show that context-aware augmentation improves robustness: every augmented variant outperforms the dataset-only baseline on both original and manipulated test images, partially recovering performance lost to prediction-suppression failures by exposing models to object--context decoupling during training.