Search papers, labs, and topics across Lattice.
This paper explores HDR video generation by adapting pre-trained generative models, avoiding the need to train new models or encoders. They find that a logarithmic encoding aligns HDR imagery with the latent space of pre-trained models, enabling fine-tuning for HDR generation. They further introduce a camera-mimicking degradation training strategy to recover details not directly observable in the input, leading to high-quality HDR video generation.
Forget complex HDR-specific architectures: a simple log encoding and camera-aware training unlocks high-quality HDR video generation from off-the-shelf generative models.
High dynamic range (HDR) imagery offers a rich and faithful representation of scene radiance, but remains challenging for generative models due to its mismatch with the bounded, perceptually compressed data on which these models are trained. A natural solution is to learn new representations for HDR, which introduces additional complexity and data requirements. In this work, we show that HDR generation can be achieved in a much simpler way by leveraging the strong visual priors already captured by pretrained generative models. We observe that a logarithmic encoding widely used in cinematic pipelines maps HDR imagery into a distribution that is naturally aligned with the latent space of these models, enabling direct adaptation via lightweight fine-tuning without retraining an encoder. To recover details that are not directly observable in the input, we further introduce a training strategy based on camera-mimicking degradations that encourages the model to infer missing high dynamic range content from its learned priors. Combining these insights, we demonstrate high-quality HDR video generation using a pretrained video model with minimal adaptation, achieving strong results across diverse scenes and challenging lighting conditions. Our results indicate that HDR, despite representing a fundamentally different image formation regime, can be handled effectively without redesigning generative models, provided that the representation is chosen to align with their learned priors.
