Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces Triangular-Masked Blind-Spot Network (TM-BSN) for self-supervised image denoising that addresses spatially correlated noise in real-world sRGB images by using a triangular-masked convolution. This convolution creates a diamond-shaped blind spot, aligning the receptive field with the spatial correlation of noise introduced by demosaicing, thereby avoiding the need for downsampling. TM-BSN further employs knowledge distillation to transfer knowledge from multiple blind-spot predictions into a U-Net, leading to state-of-the-art denoising performance on real-world benchmarks.
Achieve state-of-the-art self-supervised image denoising by explicitly modeling the spatial correlation of real-world sRGB noise, outperforming existing methods without resorting to downsampling or post-processing.
Blind-spot networks (BSNs) enable self-supervised image denoising by preventing access to the target pixel, allowing clean signal estimation without ground-truth supervision. However, this approach assumes pixel-wise noise independence, which is violated in real-world sRGB images due to spatially correlated noise from the camera's image signal processing (ISP) pipeline. While several methods employ downsampling to decorrelate noise, they alter noise statistics and limit the network's ability to utilize full contextual information. In this paper, we propose the Triangular-Masked Blind-Spot Network (TM-BSN), a novel blind-spot architecture that accurately models the spatial correlation of real sRGB noise. This correlation originates from demosaicing, where each pixel is reconstructed from neighboring samples with spatially decaying weights, resulting in a diamond-shaped pattern. To align the receptive field with this geometry, we introduce a triangular-masked convolution that restricts the kernel to its upper-triangular region, creating a diamond-shaped blind spot at the original resolution. This design excludes correlated pixels while fully leveraging uncorrelated context, eliminating the need for downsampling or post-processing. Furthermore, we use knowledge distillation to transfer complementary knowledge from multiple blind-spot predictions into a lightweight U-Net, improving both accuracy and efficiency. Extensive experiments on real-world benchmarks demonstrate that our method achieves state-of-the-art performance, significantly outperforming existing self-supervised approaches. Our code is available at https://github.com/parkjun210/TM-BSN.