Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Partial-Reference Image Quality Assessment (PR-IQA), a novel framework for evaluating the quality of diffusion-generated novel views in sparse-view synthesis without ground truth data. PR-IQA constructs a geometrically consistent partial quality map from overlapping regions with reference views and then completes it using a cross-attention mechanism to ensure cross-view consistency. Integrating PR-IQA into a diffusion-augmented 3D Gaussian Splatting pipeline, by restricting supervision to high-confidence regions, significantly improves 3D reconstruction and novel view synthesis compared to existing IQA methods.
Ditch the ground truth: this method achieves full-reference-level image quality assessment for diffusion-generated novel views by cleverly leveraging partial reference views and cross-attention.
Diffusion models are promising for sparse-view novel view synthesis (NVS), as they can generate pseudo-ground-truth views to aid 3D reconstruction pipelines like 3D Gaussian Splatting (3DGS). However, these synthesized images often contain photometric and geometric inconsistencies, and their direct use for supervision can impair reconstruction. To address this, we propose Partial-Reference Image Quality Assessment (PR-IQA), a framework that evaluates diffusion-generated views using reference images from different poses, eliminating the need for ground truth. PR-IQA first computes a geometrically consistent partial quality map in overlapping regions. It then performs quality completion to inpaint this partial map into a dense, full-image map. This completion is achieved via a cross-attention mechanism that incorporates reference-view context, ensuring cross-view consistency and enabling thorough quality assessment. When integrated into a diffusion-augmented 3DGS pipeline, PR-IQA restricts supervision to high-confidence regions identified by its quality maps. Experiments demonstrate that PR-IQA outperforms existing IQA methods, achieving full-reference-level accuracy without ground-truth supervision. Thus, our quality-aware 3DGS approach more effectively filters inconsistencies, producing superior 3D reconstructions and NVS results.The project page is available at https://kakaomacao.github.io/pr-iqa-project-page/.