Search papers, labs, and topics across Lattice.
This paper introduces UnfoldArt, a novel approach for zero-shot recovery of articulated 3D objects from text or image inputs by leveraging a debate-driven agentic framework. The method combines high-level reasoning about object semantics and motion with low-level estimation of articulation parameters through a structured two-round debate, enabling the recovery of occluded geometry and internal structures. The results demonstrate significant improvements in reconstructing high-fidelity articulated objects, revealing details that traditional methods struggle to infer from sparse observations.
Articulated 3D object reconstruction can now achieve high fidelity and internal structure recovery from mere text or images, thanks to a debate-driven agentic approach.
Articulated 3D objects are essential for interactive environments in embodied AI, robotics, and virtual reality, but reconstructing their structure and motion from sparse observations remains challenging. Existing approaches remain largely constrained by lack of supervised data or lack the priors needed to reliably recover articulation, hidden geometry, and internal object structure. We present the first debate-driven agentic approach to articulated 3D object reconstruction from text or image inputs that both grounds articulation reasoning in concrete motion and exposes the occluded geometry revealed under articulation. High-level agents reason about object semantics and motion using knowledge from vision-language and video models, while low-level agents estimate articulation parameters and interaction points; together, they engage in a two-round structured debate that first exploits global--local disagreement and then grounds the agents in freely generated video. The same video prior, conditioned on the agreed articulation, then drives each part through its motion to expose occluded interiors and geometry that cannot be inferred from a single static view. By combining agentic reasoning with a video generative prior, our approach jointly infers articulation and reconstructs complete 3D articulated objects, producing high-fidelity geometry, internal structure, and motion-consistent states beyond directly observed surfaces.
