Search papers, labs, and topics across Lattice.
PhotoQuilt introduces a novel framework for generating high-resolution photomosaics without the need for extensive training, addressing the computational challenges of maintaining both local detail and global coherence. By employing a bootstrapped tiled denoising approach, the method first establishes a low-resolution global layout before upscaling and reintroducing noise to enhance tile-level detail. Experimental results demonstrate that PhotoQuilt significantly surpasses existing methods in achieving both realistic local tiles and a coherent overall structure, all while scaling efficiently to large canvases.
Achieving high-resolution photomosaics without training, PhotoQuilt outperforms traditional methods by balancing local detail and global coherence.
Photomosaics are large images whose local regions are seen as independent tiles while their overall arrangement forms a coherent scene. Generating them at high resolution, with every tile convincing in its own right, is computationally expensive, since the canvas must hold many detailed tiles at once. We present PhotoQuilt, a training-free framework that generates photomosaics at arbitrary resolution. Diffusion models struggle to satisfy both scales at once, as direct high-resolution generation is costly and tends toward one smooth image rather than a mosaic, while patch-based tiling keeps local detail but loses global structure. PhotoQuilt resolves this with a bootstrapped tiled denoising procedure. We first produce a global composition at low resolution to fix the layout, then upscale it in latent space and re-inject noise to restore generative capacity. Denoising proceeds within fixed tiles, so each forms its own image while the shared global structure holds them in one layout. Because tile generation is handled separately, PhotoQuilt scales to large canvases without quadratic attention cost. Experiments show that PhotoQuilt outperforms current baselines on both global structure and local realism.
