Search papers, labs, and topics across Lattice.
This paper introduces a novel skeleton detection paradigm that prioritizes depth images over RGB images, addressing the significant performance degradation observed in complex-content scenarios. By leveraging the insensitivity of depth images to color and texture, the proposed model DDSkel effectively captures regional contours and spatial relationships, enhancing detection accuracy. Remarkably, DDSkel achieves superior performance on the challenging SymPASCAL dataset while utilizing only 36% of the parameters of the leading existing methods.
Depth images can revolutionize skeleton detection, outperforming traditional RGB-based methods while using significantly fewer parameters.
To date, all natural scene skeleton detection follows the paradigm of taking RGB images as the sole input; despite notable progress, methods under this paradigm suffer significant performance degradation on complex-content images. We observe that depth images are inherently insensitive to color and texture, and can provide clear regional contours and inter-region spatial relationships, which naturally alleviates the difficulty of skeleton detection in complex scenarios. Motivated by this observation, this paper proposes for the first time a novel skeleton detection paradigm where depth images serve as the dominant modality and RGB images act as the auxiliary, and accordingly presents a model DDSkel (short for Depth-Dominant Skeleton Detection) under this paradigm. DDSkel employs an asymmetric encoder design to fuse RGB information into depth features, with the RGB modality branch having only 12% the parameters of the depth modality branch. DDSkel has a simple structure without intricate designs. Nevertheless, with only 36% of the trainable parameters of the current best method, DDSkel outperforms all state-of-the-art approaches on SymPASCAL, the most challenging dataset with a large volume of complex images.
