Search papers, labs, and topics across Lattice.
The paper introduces CR-Refiner, a training-free reranker designed to enhance edit-conditioned 3D scene retrieval by effectively pairing reference rooms with natural-language modifications. It addresses the limitations of previous methods by employing an unbalanced optimal-transport problem to score candidates based on a cost matrix that considers category, style, material, and geometry, while also incorporating structural priors for geometric and spatial edits. The results demonstrate that CR-Refiner significantly improves retrieval accuracy across various edit axes, showcasing its effectiveness on a newly released benchmark, 3D-CER, which includes 4,963 queries over a large corpus of indoor rooms.
CR-Refiner outperforms existing methods in 3D scene retrieval, achieving improved accuracy through a novel optimal-transport approach that adapts to complex edit conditions.
Edit-conditioned 3D scene retrieval pairs a reference 3D room with a natural-language modification and retrieves rooms from a corpus that satisfy the edit. Three lines of prior work each fall short on this task. 2D composed image retrieval reasons over pixel-level edits and has no primitive for 3D object sets. 3D foundation encoders embed individual objects but cannot compose at the scene level. 3D scene-grounding methods localize references inside a static scene rather than rank modified rooms across a corpus. We present CR-Refiner, a training-free reranker that wraps any base retriever's top-K candidates with three components. A frozen LLM parses the edit into a structured query entity, and each candidate is scored by an unbalanced optimal-transport problem over a 1xG cost matrix coupling category, style, material, and geometry. The unbalanced solver lets the single-entity query drop mass on irrelevant objects, modelling the asymmetry directly. An axis-conditional structural prior adds size-keyword cues for geometric edits and subject-anchor direction cues for spatial edits. An LLM verifier refines the top three candidates with continuous confidence. Because no benchmark evaluates compositional matching over 3D object sets, we additionally release 3D-CER, 4,963 edit-conditioned queries over a 23,381-room indoor corpus across five edit axes, with multi-positive ground truth, CIRR-style hard subsets, and zero-target adversarials. Across three qualitatively distinct base retrievers, CR-Refiner consistently improves hard-subset R@1 and mAP@10 on every edit axis.
