Search papers, labs, and topics across Lattice.
This paper investigates the predictive discrepancies between detector-based and query-based scene graph generation (SGG) methods, revealing that each approach offers complementary insights. By establishing a controlled experimental setup focused on detector-conditioned reachability, the authors highlight how these differences can be leveraged. The introduction of a Dual-SGG method, which integrates both reasoning mechanisms through a dual-query design, significantly enhances performance across multiple datasets, including Visual Genome and Open Images v6.
Detector-based and query-based methods yield complementary insights, and combining them can dramatically improve scene graph generation performance.
Scene graph generation (SGG) approaches can be broadly classified into detector-based and query-based methods according to their underlying reasoning mechanisms. However, the discrepancy in their predictive behaviors, induced by these distinct mechanisms, has not been systematically analyzed. In this work, we design a controlled experimental setup to examine prediction discrepancies from the perspective of detector-conditioned reachability. The results suggest clear complementary clues. Motivated by this observation, we introduce a Dual-SGG method that consolidates both reasoning mechanisms via a dual-query design, thereby leveraging the complementary predictive behaviors of both detector-based and query-based methods. Extensive experiments on the Visual Genome, Open Images v6, and GQA-200 datasets demonstrate the effectiveness of the proposed method.
