Search papers, labs, and topics across Lattice.
This paper introduces the Liquid Fusion Network (LFNet), which harmonizes heterogeneous representations from State Space Models (SSMs) and Convolutional Neural Networks (CNNs) to enhance General Salient Object Detection (SOD). By employing a dynamic gating mechanism inspired by Liquid Neural Networks, LFNet effectively integrates features from both architectures, addressing their complementary spectral biases and enabling the model to scale to multi-modal cues. Experimental results across five diverse tasks demonstrate that LFNet achieves state-of-the-art performance, balancing detection accuracy with model efficiency.
LFNet's innovative liquid fusion approach reveals how harmonizing spectral biases from CNNs and SSMs can dramatically enhance salient object detection across multiple modalities.
General Salient Object Detection (SOD) aims to identify and segment visually interesting objects from uni-modality or multi-modality scenes, recently advanced by cutting-edge State Space Models (SSMs). However, a critical limitation of current approaches is their neglect of the inherent spectral biases exhibited by different neural network paradigms. By digging to the dataset-level spectral analysis of Convolutional Neural Networks (CNNs) and SSMs, their semantic representations are inherently complementary based on their complementary frequency preferences. Inspired by this, we harmonize heterogeneous representations from SSMs and CNNs to bridge their spectral biases for general salient object detection. To this end, inspired by the dynamic information propagation of Liquid Neural Networks (LNNs), we introduce a liquid fusion to dynamically integrates features from two backbones, including VMamba and ConvNeXt, referred to Liquid Fusion Network (LFNet). Concretely, by treating the continuous VMamba features and ConvNeXt features as evolving states and exogenous stimulus, respectively, LFNet employs a dynamic gating mechanism for content-aware feature aggregation. Crucially, this state-stimulus paradigm enables to scale to multi-modal cues, resulting in flexibility in general SOD. Besides, a Saliency-Guided Upsampling (SGU) operator to propagate the features to the shallow layer, which leverages a spectral-spatial co-design to suppress upsampling artifacts while preserving semantics. Extensive experiments across five diverse tasks (RGB, RGB-D, RGB-T, VSOD, and VDT) demonstrate that LFNet achieves state-of-the-art performance, offering a superior trade-off between detection accuracy and model efficiency. Code has been released at https://github.com/cke520/LFNet.
