Search papers, labs, and topics across Lattice.
This paper introduces LoTA-N2N, a two-stage framework for zero-shot self-supervised image denoising that addresses the limitations of traditional MSE-based objectives, particularly in the presence of correlated and spatially nonstationary noise. By training a denoiser on complementary sub-image pairs and leveraging detached clean-sub-image proxies, the method effectively estimates and suppresses the residual-prediction interaction, thereby mitigating spatial cancellation effects. Experimental results across various imaging modalities demonstrate significant improvements over conventional MSE adaptation, highlighting the method's robustness in diverse noise conditions.
Local interaction control in self-supervised denoising can dramatically enhance performance, revealing hidden regional dynamics that traditional methods overlook.
Single-image self-supervised denoising replaces unavailable clean targets with surrogate targets constructed from noisy observations. Its effectiveness therefore depends on how closely the surrogate objective remains aligned with supervised denoising, especially when noise is correlated, spatially nonstationary, or unknown. We express the discrepancy between a broad class of MSE-based self-supervised objectives and supervised MSE as a parameter-independent constant and a trace interaction between the surrogate-target residual and the prediction error. The corresponding gradient discrepancy is determined by the gradient of this interaction. This formulation provides a common view of paired-noise, blind-spot, weak-noise, re-corruption, and sub-image methods, while revealing that a small global interaction may conceal substantial positive and negative regional interactions through spatial cancellation. Building on these observations, we propose LoTA-N2N, a two-stage zero-shot adaptation framework. Stage 1 trains a denoiser on complementary sub-image pairs and freezes it to construct detached clean-sub-image proxies. Stage 2 estimates the residual--prediction interaction using these proxies and suppresses its patch-wise absolute magnitude. We show that the local construction prevents spatial cancellation and upper-bounds the magnitude of the corresponding global interaction. Experiments across natural, confocal, and X-ray images, complemented by iteration-matched controls, controlled noise shifts, and gradient diagnostics, show consistent gains over MSE-only adaptation under IID, spatially varying, and mixed noise. Overall, LoTA-N2N demonstrates that estimated local interaction and spatial cancellation control provide effective design principles for single-image self-supervised denoising without paired clean targets, repeated acquisitions, or a predefined re-corruption model.
Tsinghua AI