Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces RealOOB, a comprehensive benchmark for occlusion boundaries (OBs) that addresses the limitations of existing datasets by providing 4.26M definition-consistent, geometry-grounded labels for both inter-object and self-occlusion boundaries. The benchmark includes validity-aware occlusion-orientation maps, enabling precise supervision based on measurable depth ordering, which is critical for accurate scene understanding. Evaluation of forty OB estimators and edge detectors reveals that while modern edge detectors excel in localization, they struggle with orientation prediction, highlighting a significant gap in occlusion reasoning capabilities across current methods.
Modern edge detectors rival traditional OB methods in localization but falter in orientation prediction, exposing a critical gap in occlusion reasoning.
Occlusion boundaries (OBs) are pixel-level image boundaries corresponding to surface visibility discontinuities caused by occlusion. Through precise boundary localisation and occlusion orientation, OBs encode local surface layout and depth ordering, providing geometry-driven mid-level cues for scene understanding. However, progress in pixel-level OB estimation has been limited by fragmented supervision: Existing benchmarks often suffer from limited coverage, category-specific designs, missing self-occlusion annotations, or inconsistent annotation definitions. Meanwhile, modern edge detectors and monocular depth estimators have become strong boundary and geometry predictors, yet their relationship to definition-consistent OBs remains underexplored. We introduce RealOOB, a carefully annotated real-world benchmark with 4.26M definition-consistent, geometry-grounded OB labels covering both inter-object and self-occlusion boundaries, together with validity-aware occlusion-orientation maps that restrict supervision to pixels whose cross-boundary depth ordering is reliably measurable. Based on RealOOB, we evaluate forty OB estimators and edge detectors alongside six monocular depth estimators. Our evaluation reveals a clear gap in occlusion reasoning: modern edge detectors perform competitively with OB methods in localisation, whereas orientation prediction remains challenging for all evaluated methods. Meanwhile, even strong depth estimators often fail to exhibit measurable geometry at true OBs. We believe RealOOB provides a strong reference benchmark for the OB estimation community and a real-world testbed for assessing depth discontinuities and geometry fidelity in broader low-level vision tasks. Dataset and code will be released.