Search papers, labs, and topics across Lattice.
This paper introduces Amortized Anchor Refinement, a method that optimizes continuous-time 4D Gaussian reconstruction for XR headsets by combining feed-forward predictions with a brief optimization phase under strict compute constraints. The approach effectively maintains representational density while allowing for scene-specific details to be captured, addressing the challenges of per-scene optimization that typically require excessive computational resources. On the Stage-Capture benchmark, this method achieves a notable reconstruction quality of 24.31卤2.22dB, demonstrating its feasibility for real-time deployment on consumer-grade hardware.
Achieving high-quality 4D Gaussian reconstruction on consumer XR devices without sacrificing detail or exceeding compute budgets could revolutionize immersive experiences.
Continuous-time 4D reconstruction remains impractical on standalone XR headsets. Per-scene optimization demands deployment-infeasible compute, and lower budgets cause collapse rather than degrade gradually. Feed-forward prediction is fast, but struggle to recover scene-specific detail. We present Amortized Anchor Refinement, which uses a frozen backbone to predict an initial Gaussian representation and a short optimization to specialize it under a fixed compute budget, with a capacity floor preserving representational density. A training-free stage then applies a persistent-homology constraint to prune unstable Gaussians while preserving topologically persistent structures, and streams the resulting trajectories directly as scene flow. On the Stage-Capture benchmark, Amortized Anchor Refinement achieves 24.31$\pm$2.22dB, while our deployment experiments demonstrate reconstruction within the target budget on a single consumer GPU and playback on a standalone XR headset.
