Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces U-CFR, an innovative framework for interactive image segmentation that enhances the efficiency of image annotation by autonomously self-correcting after each user interaction. By integrating a boundary-aware uncertainty score that combines segmentation uncertainty, contour gradients, and edge predictions, U-CFR intelligently generates internal pseudo-clicks to refine segmentation masks in ambiguous areas. Experimental results show that U-CFR significantly reduces the number of required corrective clicks by over 10% on challenging datasets, while improving both initial mask quality and boundary accuracy.
U-CFR reduces the need for manual corrections in interactive segmentation by over 10% through intelligent self-correction using uncertainty-driven pseudo-clicks.
Interactive image segmentation is critical for efficient image annotation; however, existing methods often require many corrective clicks or rely on passive refinement schemes that converge slowly. We propose Uncertainty-Guided Cascade Forward Refinement (U-CFR), a novel inference-time framework that enables models to autonomously self-correct after each user interaction. U-CFR introduces a boundary-aware uncertainty score that fuses segmentation uncertainty, contour gradients, and explicit edge predictions to guide the placement of internal pseudo-clicks. These self-generated clicks target the most ambiguous boundary regions, providing strong corrective signals without additional manual input. To support this process, we design a dual-head network with a shared encoder-decoder backbone: a segmentation head ensures region consistency, while an edge head sharpens boundary alignment. In inference, U-CFR launches a cascade of refinement steps, where each stage leverages the uncertainty-driven pseudo-clicks to refine the mask progressively. Experiments on standard benchmark datasets demonstrate that the proposed U-CFR improves click efficiency, initial mask quality, and boundary accuracy. It reduces the required clicks by over 10% on challenging datasets like Berkeley and offers a more intelligent and efficient interactive annotation.