Search papers, labs, and topics across Lattice.
This paper introduces FADRA, a frequency-aware diffusion framework designed for video face restoration (VFR) that enhances both spatial fidelity and temporal coherence in degraded video sequences. By integrating lightweight LoRA adapters and a Repeated Residual Adaptation Head (RRAH), FADRA effectively adapts a pre-trained text-to-video diffusion model to the specific challenges of VFR, allowing for iterative refinement based on low-quality cues. Experimental results indicate that FADRA significantly outperforms existing methods, achieving superior facial detail recovery and temporal consistency, as evidenced by both quantitative metrics and visual assessments.
FADRA achieves unprecedented facial detail recovery and temporal consistency in video face restoration, outperforming state-of-the-art techniques.
Video face restoration (VFR) aims to recover high-quality and temporally consistent facial details from severely degraded video sequences; however, existing methods still struggle to balance spatial fidelity and temporal coherence under complex degradations. To address this, we propose FADRA, a frequency-aware diffusion framework with iterative residual adaptation specifically tailored for robust VFR. We first leverage the strong temporal consistency of a pre-trained text-to-video diffusion model and introduce lightweight LoRA adapters together with a Low-Quality (LQ) Pixel-Alignment Feature Fusion module to efficiently adapt the frozen generative prior to the VFR task. To further adapt the frozen diffusion backbone to the downstream VFR task beyond LoRA-based adaptation, we introduce a Repeated Residual Adaptation Head (RRAH) for step-wise residual refinement after the diffusion backbone. To make this refinement explicitly guided by the degraded observation, RRAH further takes the LQ latent together with the current velocity prediction as input, allowing the model to repeatedly revisit LQ cues and predict residual updates at each flow-matching step. This LQ-guided repeated residual adaptation helps recover fine facial details while preserving the inherent temporal priors of the pre-trained model. Furthermore, to ensure the structural integrity of perceptually important details, we introduce a Frequency-Aware Loss that provides explicit supervision across multiple spectral bands, emphasizing visually sensitive frequency components that are crucial for perceptual quality and prone to temporal jittering. Extensive experiments demonstrate that FADRA recovers better facial structures and produces more temporally consistent videos than state-of-the-art methods, leading to clear gains in both quantitative metrics and visual perception.
