Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces TUDSR, a Twice Upsampling-Diffusion framework designed to enhance image super-resolution (SR) by addressing the limitations of existing diffusion models when upsampling beyond their native resolution. By employing a two-stage training process that includes both R-resolution and NR-resolution training with a looped chunk-based strategy, TUDSR-S achieves state-of-the-art results in generating high-quality images at resolutions of 1024² and 2048². The method effectively mitigates the computational overhead associated with training high-resolution models while significantly improving output quality compared to previous approaches.
TUDSR-S outperforms existing models in generating high-resolution images, achieving unprecedented quality at 2048² without the need for larger architectures.
Diffusion-based generative models have achieved remarkable success in real-world image super-resolution (SR). With tiled diffusion techniques, these models can produce high-resolution images that exceed their native-supported resolution. However, the quality of such high-resolution (e.g $2048^2$) outputs often remains extremely poor, primarily due to two factors we consider: the image upsampling ratio (e.g $\times8$) exceeding the model's native-supported upsampling ratio (e.g $\times4$), and the model's native-supported resolution. In practice, training a native high-resolution model requires larger architectures, which incur significant computational overhead and GPU memory costs, making it hard on limited-resource equipment. Thus, we present TUDSR, a Twice Upsampling-Diffusion framework for higher SR. The TUDSR framework mainly consists of two stages: the first involves training at $R$-resolution, and the second introduces a looped chunk-based training strategy at $NR$-resolution. Each stage adapts a one-step GAN architecture comprising a generator and a discriminator. Based on SD2.1-base, we develop TUDSR-S, which achieves state-of-the-art performance across multiple benchmarks. Extensive experiments further demonstrate that TUDSR-S generates high-quality images at the resolutions of $1024^2$ and even $2048^2$, significantly outperforming existing approaches. Code is available at https://github.com/wuer5/TUDSR.