Search papers, labs, and topics across Lattice.
This paper introduces MVTrack, an ultrafast moving object tracker that operates directly on H.264 bitstreams, significantly reducing the computational burden associated with traditional RGB-based object detection. By integrating MVDet, a lightweight detector for motion vector fields, with MVLink, a minimalist kinematic association module, MVTrack achieves superior performance on the VIRAT dataset. Notably, it outperforms YOLO26n while utilizing 60 times fewer parameters and requiring 40 times fewer FLOPs, thereby enhancing efficiency and reducing CPU latency by 8.6 times.
Compressed video data alone can enable accurate and scalable surveillance tracking, eliminating the need for pixel reconstruction.
Deploying modern video trackers at scale is bottlenecked by the computational cost of RGB-based object detectors. To this end, we present MVTrack, an ultrafast tracker for moving objects that operates directly on H.264 bitstreams. MVTrack combines MVDet, a lightweight detector for motion vector fields, with MVLink, a minimalist kinematic association module. On VIRAT, MVTrack outperforms YOLO26n while using 60$\times$ fewer parameters, requiring 40$\times$ fewer FLOPs, and reducing CPU latency by 8.6$\times$. These results demonstrate that compressed video data alone can enable accurate and scalable surveillance tracking, thereby bypassing the need for pixel reconstruction.
