Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors introduce Patch-PODiff-ViT, a novel structured latent diffusion framework that utilizes patchwise Proper Orthogonal Decomposition (POD) to define a low-dimensional latent space for super-resolution tasks. This approach not only enhances computational efficiency by avoiding the complexities of learned nonlinear autoencoders but also allows for direct propagation of uncertainty from latent coefficients to physical-space predictive variance. Experimental results demonstrate that the method achieves high-quality reconstructions across various domains, including sea surface temperature and medical imaging, while maintaining well-calibrated spatial uncertainty with fewer parameters and reduced memory usage.
Achieving super-resolution with a structured latent space that quantifies uncertainty without the computational burden of traditional pixel-space methods.
Diffusion models enable probabilistic super-resolution and conditional generation, but pixel-space methods are computationally expensive and learned latent spaces often lack interpretable uncertainty quantification. We introduce Patch-PODiff-ViT, a structured latent diffusion framework in which the latent space is defined by patchwise Proper Orthogonal Decomposition (POD), a fixed linear orthonormal basis over local patches, rather than learned by a nonlinear autoencoder. This yields low-dimensional, variance-ordered tokens that preserve spatial structure and enable efficient diffusion in a structured low-dimensional latent space with a Vision Transformer. Because the decoder is fixed, linear, and orthonormal, latent coefficient uncertainty can be propagated directly to physical-space predictive variance, enabling analytic propagation of predictive variance through the linear decoder without Monte Carlo estimation in pixel space. Across sea surface temperature, medical imaging, and natural images, the method achieves strong reconstruction with fewer parameters and lower memory, while producing well-calibrated spatial uncertainty that closely matches empirical ensembles.