Search papers, labs, and topics across Lattice.
DiffHDR addresses the problem of converting low dynamic range (LDR) videos to high dynamic range (HDR) by formulating it as a generative radiance inpainting task within the latent space of a video diffusion model. The method operates in Log-Gamma color space to leverage spatio-temporal priors for synthesizing plausible HDR radiance in saturated regions and recovering continuous scene radiance. Experiments show DiffHDR outperforms existing methods in radiance fidelity and temporal stability, enabling realistic HDR video generation with re-exposure capabilities.
Breathe new life into dull, old videos: DiffHDR uses video diffusion models to hallucinate realistic HDR detail from LDR footage, unlocking unprecedented re-exposure latitude.
Most digital videos are stored in 8-bit low dynamic range (LDR) formats, where much of the original high dynamic range (HDR) scene radiance is lost due to saturation and quantization. This loss of highlight and shadow detail precludes mapping accurate luminance to HDR displays and limits meaningful re-exposure in post-production workflows. Although techniques have been proposed to convert LDR images to HDR through dynamic range expansion, they struggle to restore realistic detail in the over- and underexposed regions. To address this, we present DiffHDR, a framework that formulates LDR-to-HDR conversion as a generative radiance inpainting task within the latent space of a video diffusion model. By operating in Log-Gamma color space, DiffHDR leverages spatio-temporal generative priors from a pretrained video diffusion model to synthesize plausible HDR radiance in over- and underexposed regions while recovering the continuous scene radiance of the quantized pixels. Our framework further enables controllable LDR-to-HDR video conversion guided by text prompts or reference images. To address the scarcity of paired HDR video data, we develop a pipeline that synthesizes high-quality HDR video training data from static HDRI maps. Extensive experiments demonstrate that DiffHDR significantly outperforms state-of-the-art approaches in radiance fidelity and temporal stability, producing realistic HDR videos with considerable latitude for re-exposure.
