Search papers, labs, and topics across Lattice.
UniQuery4R introduces a novel query-conditioned framework for dynamic 4D scene reconstruction that efficiently estimates correspondence, geometry, object motion, and camera motion from a single query. By leveraging source-to-target cross-attention and encoding multi-frame clips only once, it minimizes computational overhead and enhances feature reuse across varying frame pairs. The approach outperforms existing methods on the WorldTrack benchmark, achieving superior results in both scene-flow estimation and dynamic-point reconstruction.
Achieving the best macro-average results on dynamic scene reconstruction benchmarks, UniQuery4R redefines efficiency in 4D scene understanding.
Reconstructing dynamic 4D scenes requires jointly estimating correspondence, geometry, object motion, and camera motion. Existing feed-forward methods typically predict dense task-specific maps or independently process source-target pairs, leading to unnecessary computation for sparse queries and limited feature reuse across different frame pairs. We present UniQuery4R, a query-conditioned framework that encodes a multi-frame clip once and selects the source view, target view, and continuous source-image coordinate only at decoding time via source-to-target cross-attention. Each query jointly predicts target correspondence, target-time 3D position, and scene flow, along with source depth, while camera parameters are estimated per view. This design allows the encoded clip to be reused across arbitrary source-target selections and supports both sparse inference and dense reconstruction through batched queries, without learned temporal embeddings tied to a fixed clip length. We further introduce a direction-magnitude parameterization of scene flow with separate supervision for moving and static points. Among the evaluated methods, UniQuery4R achieves the best macro-average results on WorldTrack for both scene-flow estimation and dynamic-point reconstruction.
Tsinghua AI