Search papers, labs, and topics across Lattice.
This paper introduces Prompt-Free Universal Region Proposal Network (PF-RPN), a novel approach for identifying potential objects in images without relying on external prompts like exemplar images or text descriptions. PF-RPN uses a Sparse Image-Aware Adapter (SIA) for initial localization, a Cascade Self-Prompt (CSP) module for identifying remaining objects, and a Centerness-Guided Query Selection (CG-QS) module for selecting high-quality query embeddings. Experiments across 19 datasets demonstrate the effectiveness of PF-RPN, even when trained on limited data and applied to diverse object detection domains without fine-tuning.
Forget prompt engineering: this new region proposal network spots objects across diverse datasets without *any* text or image prompts.
Identifying potential objects is critical for object recognition and analysis across various computer vision applications. Existing methods typically localize potential objects by relying on exemplar images, predefined categories, or textual descriptions. However, their reliance on image and text prompts often limits flexibility, restricting adaptability in real-world scenarios. In this paper, we introduce a novel Prompt-Free Universal Region Proposal Network (PF-RPN), which identifies potential objects without relying on external prompts. First, the Sparse Image-Aware Adapter (SIA) module performs initial localization of potential objects using a learnable query embedding dynamically updated with visual features. Next, the Cascade Self-Prompt (CSP) module identifies the remaining potential objects by leveraging the self-prompted learnable embedding, autonomously aggregating informative visual features in a cascading manner. Finally, the Centerness-Guided Query Selection (CG-QS) module facilitates the selection of high-quality query embeddings using a centerness scoring network. Our method can be optimized with limited data (e.g., 5% of MS COCO data) and applied directly to various object detection application domains for identifying potential objects without fine-tuning, such as underwater object detection, industrial defect detection, and remote sensing image object detection. Experimental results across 19 datasets validate the effectiveness of our method. Code is available at https://github.com/tangqh03/PF-RPN.
