Search papers, labs, and topics across Lattice.
This paper introduces P-PatchDiff, a progressive patch diffusion framework designed for low-light image enhancement that dynamically adjusts patch sizes during the denoising process. By employing a Multi-Patch Alignment strategy, the model effectively normalizes features across varying patch scales, ensuring coherent brightness and color across the entire image. The results show that P-PatchDiff enhances images from 400 × 600 to 4K resolution while achieving an impressive 80× speedup compared to existing methods, all while maintaining low memory usage.
P-PatchDiff achieves 80× faster low-light image enhancement by dynamically adjusting patch sizes, ensuring coherent brightness across varying scales.
Recent advancements in low-light image enhancement have leveraged diffusion models for their strong ability to generate perceptually realistic, detailed images. Patch diffusion models further offer a promising solution to size-agnostic image restoration while improving efficiency. However, existing methods typically rely on small, fixed patches (e.g., 64$\times$64) that cannot capture image-level brightness context, whereas enlarging the receptive field improves brightness and colour estimation but substantially increases computational cost. Moreover, low-light images often exhibit uneven brightness across regions, making it necessary to ensure that locally enhanced patches remain visually coherent when combined into the full image. To address these limitations, we propose P-PatchDiff, a scalable progressive patch diffusion framework for low-light image enhancement that dynamically adjusts patch size throughout the denoising process, enabling a gradual shift from local to global views. A Multi-Patch Alignment strategy is also introduced to normalise features across varying patch scales using an estimated global brightness proxy. Rather than pursuing pixel-level reconstruction accuracy, P-PatchDiff focuses on scalability and coherent brightness across the whole image, allowing the model to perceive multi-scale information and better enhance regions with varying brightness. We empirically demonstrate that P-PatchDiff effectively enhances images ranging from 400 $\times$ 600 to 4K and is 80$\times$ faster than existing patch diffusion models while using less than 9GB of memory. The code is available at https://github.com/RuoyuGuo/P-PatchDiff.