Search papers, labs, and topics across Lattice.
This paper introduces FoA-SR, a novel approach to image super-resolution that optimizes restoration based on specific profiles鈥擣aithful and Aesthetic. By employing a supervised FLUX.2-based SR adapter and generating a stochastic candidate pool for each input image, the method ranks candidates using profile-specific rewards to fine-tune separate LoRA adapters. Experiments demonstrate that FoA-SR effectively steers the same SR adapter towards distinct objectives, achieving improved reference consistency for Faithful restorations and enhanced perceptual quality for Aesthetic restorations, revealing that these profiles often select different optimal outputs.
FoA-SR reveals that tailoring super-resolution strategies to specific profiles can yield significantly better results, with distinct adapters for Faithful and Aesthetic outputs.
Real-world image super-resolution (SR) is often designed with a single restoration objective, despite the current capacity of generative models to produce multiple high-quality reconstructions for the same input. In this paper, we argue that the best restoration strategy is subject to the specific restoration profile: a Faithful restoration prioritizes reference consistency, structure preservation, and hallucination suppression, whereas an Aesthetic restoration prioritizes visually pleasing and natural-looking details. We propose FoA-SR, a novel preference optimization approach to real-world SR based on profiles. To achieve this goal, FoA-SR starts with our supervised FLUX.2-based SR adapter (Flux2SR) trained with LR latent conditioning, flow matching, and image-space reconstruction losses for paired LR-to-HR image super-resolution. Following the development of the shared supervised super-resolution adapter, FoA-SR generates a shared stochastic candidate pool for each input image and ranks the same candidates using profile-specific Faithful and Aesthetic rewards to mine winner-loser pairs. These pairs are used to fine-tune separate LoRA adapters while keeping the base model frozen. Experiments on RealSR and DIV2K show that FoA-SR can steer the same SR adapter towards distinct restoration objectives: a Faithful adapter improves reference-consistent metrics while an Aesthetic adapter boosts metrics that measure perceptual quality without reference. Our candidate-pool analysis shows that Faithful and Aesthetic rewards frequently select different winners, and a Hybrid-LoRA ablation shows that collapsing both profiles into one reward yields an implicit compromise rather than explicit profile control.
