Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces FUSE-Flow, a decoupled framework designed to enhance real-time multi-view point cloud fusion by separating the processes of calibration and fusion. The framework consists of two components: geometry-aligned multi-view extrinsic calibration (GMAC) for precise camera pose estimation without traditional calibration targets, and a reliability-guided fusion module (FUSE) that utilizes confidence weighting and adaptive spatial hashing for efficient data integration. Experimental results demonstrate that FUSE-Flow significantly improves visual quality, dynamic stability, and scalability compared to existing methods, making it a robust solution for large-scale 3D reconstruction tasks.
FUSE-Flow achieves superior real-time 3D reconstruction by decoupling calibration from fusion, leading to enhanced accuracy and scalability without the need for calibration targets.
Real-time multi-camera 3D reconstruction is a key foundation for immersive media, remote interaction and spatial computing. While synchronized camera arrays are widely adopted, achieving geometrically consistent and scalable real-time reconstruction remains challenging. A key challenge is the close linkage among extrinsic calibration, multi-view fusion and global optimization, which causes fluctuating reconstruction results, cumulative errors and poor system expandability. We propose a decoupled framework for calibration and stateless real-time multi-view point cloud fusion (FUSE-Flow), a framework with two collaborative components: geometry-aligned multi-view extrinsic calibration (GMAC) and reliability-guided multi-view point cloud fusion (FUSE). This split design avoids conflicting optimization objectives for targeted improvement. The GMAC module refines camera extrinsics via geometric constraints and multi-view reconstruction transformers, enabling accurate sparse-view calibration without calibration targets, dense images or global bundle adjustment. The FUSE module integrates confidence weighting and adaptive spatial hashing for stateless fusion, ensuring linear time and memory consumption. The two modules mutually reinforce each other: accurate camera poses boost fusion accuracy, and confidence-aware fusion corrects calibration biases. Validated on public datasets and real camera setups, FUSE-Flow outperforms mainstream real-time reconstruction methods in visual effect, dynamic stability and scalability, providing a practical solution for large-scale real-time 3D reconstruction.