Search papers, labs, and topics across Lattice.
This paper introduces EgoHieraLoc, a hierarchical framework for egocentric visual query localization (VQL) that leverages human-like perceptual processes to improve object localization in complex video environments. By integrating a Discriminative Parsing Module for foreground-aware representation, a Query-Aware Module for robust localization, and a Regional Adaptation Module for precise boundary recovery, the framework effectively addresses challenges posed by ambiguous object boundaries and global context. The proposed method achieves state-of-the-art results on both 2D and 3D VQL benchmarks, demonstrating its efficacy in real-world applications.
EgoHieraLoc achieves unprecedented accuracy in egocentric visual query localization by mimicking human visual processing strategies.
Visual query localization (VQL) aims to retrieve and re-localize a queried object in egocentric videos, yet remains challenging when object boundaries are ambiguous and global context cannot effectively guide fine-grained localization. Human vision handles such ambiguity through a hierarchical process: it rapidly screens foreground candidates, selectively attends to the target despite distractors, refines perception via feedback between global context and local detail, and, when a single view is unreliable, integrates evidence across viewpoints according to its credibility. Inspired by these competencies, we propose \textbf{EgoHieraLoc}, a unified framework for VQL-2D and VQL-3D. A Discriminative Parsing Module first extracts foreground-aware query representations using segmentation priors; a Query-Aware Module then performs robust target localization through discriminative correlation filtering with deformable modeling; and a Regional Adaptation Module feeds multi-scale context back into local regions to recover precise object boundaries. To extend this perceptual hierarchy to 3D localization, we introduce Geometric-Semantic Joint Confidence (GSJC), which multiplicatively couples segmentation confidence with local depth consistency, multi-view back-projection consistency, and triangulation-baseline quality, so that a viewpoint contributes to the 3D estimate only when it is credible both semantically and geometrically. Extensive experiments demonstrate state-of-the-art performance on both VQL-2D and -3D benchmarks.
