Search papers, labs, and topics across Lattice.
This paper introduces MV3DT, a fully distributed framework for real-time multi-view 3D tracking that circumvents the computational bottlenecks associated with centralized fusion by enabling peer-to-peer coordination among camera nodes. The system achieves high accuracy in identity propagation and occlusion recovery while maintaining impressive scalability, operating at 30 FPS across 100 cameras with minimal latency and communication overhead. MV3DT's zero-shot capability allows for immediate deployment in new environments without the need for scene-specific learning, achieving competitive performance metrics of 94.3% IDF1 and 93.3% MOTA on the WILDTRACK dataset.
Real-time multi-view 3D tracking can now be achieved at scale without the computational burdens of centralized systems, thanks to a fully distributed approach.
Multi-camera tracking with overlapping fields of view typically relies on centralized fusion, which creates computational bottlenecks that prevent deployment at scale. We present MV3DT, a fully distributed framework for real-time multi-view 3D tracking that achieves accurate identity propagation and occlusion recovery through peer-to-peer coordination, eliminating the need for central aggregation. Each camera node executes a lightweight modular pipeline comprising monocular 3D perception, distributed multi-view association, and collaborative fusion via lightweight messaging. MV3DT achieves 94.3% IDF1 and 93.3% MOTA on WILDTRACK, competitive with state-of-the-art centralized methods, while demonstrating superior scalability by sustaining 30 FPS on 100 cameras with less than 10 ms inter-camera latency and only 2.2% communication overhead. MV3DT operates in a zero-shot regime given camera calibrations, requiring no scene-specific learning and making it directly deployable in new environments. These results establish MV3DT as a practical solution for real-time multi-view tracking in large-scale overlapping camera networks.
NVIDIA