Search papers, labs, and topics across Lattice.
This paper introduces a weakly-supervised RGB-D salient object detection (SOD) method that leverages a Segment Anything Model (SAM) for generating pseudo annotations and a state space interaction-based diffusion model ($S^2$Diff) for refining saliency maps. By addressing the limitations of sparse scribble annotations through a dual-branch structure in SAM-PAG, the authors enhance the quality of pixel-level annotations, while $S^2$Diff iteratively improves the accuracy of saliency maps using conditional features. The proposed method demonstrates superior performance compared to existing scribble-supervised techniques and is competitive with fully-supervised approaches across seven datasets.
Achieving competitive saliency detection accuracy with weak supervision could redefine the landscape of annotation efficiency in computer vision.
Weakly-supervised RGB-D Salient Object Detection (SOD) is explored to reduce the heavy burden of pixel-level annotations. But scribble annotations lack the structure and details of objects, resulting in inaccurate saliency maps. In this paper, we propose a novel scribble-supervised RGB-D SOD method, consisting of a Segment Anything Model (SAM)-driven pseudo annotation generation method (\emph{SAM-PAG}) and a state space interaction-based conditional diffusion model (\emph{$S^2$Diff}). Specifically, SAM-PAG is tailored to address the issue of sparse supervision information. In SAM-PAG, we adopt the advanced SAM to expand sparse scribbles to dense pixel-level pseudo annotations through the dual-branch structure and the consistency of segmentation masks. In $S^2$Diff, we adopt the diffusion model to iteratively refine the noisy saliency maps with the guidance of conditional information, generating accurate saliency maps. Naturally, the core of our $S^2$Diff lies in the acquisition of conditional features and the denoising of saliency maps. For the former, we employ a cross-modal conditional generation module to interweave cross-modal features through frequency integration and implicit-explicit state space interaction, effectively achieving global conditional features. For the latter, we employ a context injection module to mitigate noise interference and to enhance object information with the conditional context. With the close cooperation of SAM-PAG and $S^2$Diff, our method outperforms relevant scribble-supervised methods and achieves competitive performance compared to fully-supervised methods on seven datasets. The code and results of our method are available at https://github.com/Switch457/WeakS2Diff_SOD.
