Search papers, labs, and topics across Lattice.
To resolve the imprecise deformations and redundant spatial drift common in standard deformable convolutions, this work introduces Enhanced Deformable ConvNets (EDCN) for dense prediction tasks like semantic segmentation. Existing DCN variants (DCNv1鈥搗4) lack spatial anchoring and long-range context, leading to degenerate offset sampling across feature-poor regions. By anchoring the kernel center to preserve target alignment and gating deformations through classical edge-detection priors, EDCN consistently surpasses state-of-the-art DCNv1鈥搗4 architectures across standard segmentation and classification benchmarks.
Unconstrained sampling offsets routinely degrade dynamic spatial modeling鈥攆reezing the kernel's center and filtering deformations with high-frequency edge priors consistently outperforms DCNv4 without adding architectural bloat.
Deformable convolution networks have recently become popular for many computer vision tasks, especially for semantic segmentation, because of their exceptional capabilities in dynamic spatial modeling. However, due to the dense deformable offsets and the lack of longer-range dependencies, they can not fully adopt proper and precise deformations for feature representations. To tackle the issues, in this paper, we propose Enhanced Deformable ConvNets (EDCN) for semantic segmentation. Specifically, a novel Enhanced Deformable Convolution (EDC) is exploited in the decoder, which integrates the Center-invariant Offset Module (COM) and Edge-aware Mask Module (EMM). The COM employs larger kernels and eliminates deformations at the kernel center, obtaining offsets that are more in line with the target from richer spatial information. Concurrently, the EMM obtains the significance of image content via Sobel edge detection, then selectively applies deformations based on the content significance, minimizing unnecessary deformations associated with relatively less important information, thereby avoiding impact from less informative regions. Experiments show that EDC outperforms state-of-the-art deformable convolution variants, including Deformable ConvNets V1-V4 and Entire Deformable ConvNets, across mainstream segmentation datasets with various decoder settings. Moreover, ablation studies confirm the effectiveness of each component. In addition, visualizations illustrate that EDC enhances spatial adaptation and target focus. We further analyze the extendibility of EDC to larger kernels on the image classification benchmark. Code will be publicly released.
