Search papers, labs, and topics across Lattice.
This paper addresses the challenge of reliable viewpoint control in reference-driven image generation across different subjects, a task complicated by the absence of explicit geometric information. The authors introduce RAVA, a retrieval-augmented framework that enhances viewpoint alignment by leveraging cross-instance viewpoint embeddings and a LogDet-based selection strategy to curate a compact set of structurally complementary reference images. Experimental results demonstrate that RAVA significantly improves viewpoint retrieval quality and outperforms existing methods in cross-subject image generation, highlighting the importance of geometric grounding in this context.
RAVA reveals that incorporating geometric evidence can drastically enhance viewpoint alignment in image generation, outperforming traditional methods that rely solely on semantic embeddings.
Reference-driven image generation has made rapid progress on identity preservation, but reliable viewpoint control across different subjects remains poorly understood. The difficulty is not merely generating a new image of the target subject: the model must infer the implicit viewpoint of one subject and transfer it to another subject using only image-level evidence, without camera poses, depth, or ray-based conditions. In this setting, existing generators conditioned on multiple image references often rely on spurious semantic correlations, which lead to viewpoint drift, part-level structural mismatches, and missing or unsupported target-specific content. We formulate this challenge as cross-subject viewpoint alignment and propose RAVA, a retrieval-augmented framework that supplies explicit geometric evidence before generation. RAVA first learns a cross-instance viewpoint embedding that retrieves target-subject images aligned with the anchor viewpoint, then applies a LogDet-based subset selection strategy to retain a compact reference set that is both view-consistent and structurally complementary. The selected references are finally consumed by a fine-tuned multi-reference image generator. Experiments show that generic semantic embeddings are nearly random for this task, while the proposed retriever substantially improves viewpoint retrieval quality. On cross-subject generation, RAVA consistently outperforms zero-shot baselines and stronger retrieval alternatives under the same generation backbone. These results indicate that cross-subject viewpoint alignment benefits from retrieval-augmented geometric grounding rather than relying on end-to-end generation alone.
