Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper presents RGFVR, a reference-guided framework for restoring face videos that maintains visual fidelity, temporal consistency, and identity preservation. By integrating bimodal perceptual-descriptive identity conditioning into a pretrained flow-based text-to-video generator and employing a two-stage training strategy, the authors enhance identity guidance during the restoration process. Experimental results demonstrate that RGFVR outperforms existing methods, particularly in challenging scenarios involving various video degradations such as downsampling and noise.
Achieving superior face video restoration, RGFVR preserves identity while enhancing visual fidelity and temporal consistency, even under severe degradation.
Face video restoration from degraded observations is challenging, as it requires simultaneously recovering visual fidelity, temporal consistency, and subject identity. Existing approaches are often either reference-free, which can lead to identity loss when person-specific facial details are lost, or subject-specific, which limits generalization to unseen identities. We propose a subject-agnostic, reference-guided framework for identity-preserving face video restoration. Our method introduces bimodal perceptual-descriptive identity conditioning into a pretrained flow-based text-to-video generator and employs a two-stage training strategy to strengthen identity guidance during restoration. Experiments show that our approach improves restoration fidelity, temporal consistency, and identity preservation, achieving superior performance under challenging video degradations, including downsampling, blur, noise, and compression artifacts. The code is available under: https://github.com/batuhanntosun/RG-FVR.