Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Addressing widespread evaluation discrepancies in multi-object tracking (MOT), this work conducts a systematic empirical audit that unifies tracking-by-detection (TBD) protocols under standardized baseline and hyperparameter controls. By progressively isolating modular components—including similarity metrics, data association, camera motion compensation, and trajectory interpolation—the authors disentangle true algorithmic improvements from detector or hyperparameter confounding. The resulting evaluation establishes the genuine marginal utility of each tracking component and synthesizes them into an optimized, highly robust baseline tracker.
Much of the reported progress in multi-object tracking stems from inconsistent baselines and hyperparameter tuning rather than algorithmic breakthroughs—and this controlled empirical audit reveals which modular components actually move the needle.
Multi-object tracking (MOT) is an essential computer vision task that simultaneously tracks multiple objects in video sequences, with various applications in surveillance, autonomous navigation, and human-computer interaction. The tracking-by-detection (TBD) paradigm, which combines object detection with temporal association, has emerged as a leading approach, driven by innovative algorithms. Despite recent progress, fair evaluation of TBD-based methods remains a challenge. Many studies introduce modules such as similarity metrics, data association strategies, or motion models, but they are often evaluated under inconsistent protocols, with different baseline trackers, hyperparameters, and datasets. Such inconsistencies obscure the genuine contribution of each module and hinder objective comparison. This survey systematically reviews TBD-based MOT techniques, including similarity measurements, data association, camera motion compensation, and interpolation strategies. Starting from a minimal baseline tracker, we fairly evaluate the contributions of each method across diverse datasets and accumulate well-balanced methods. Our findings establish a strong baseline tracker and provide a foundation for the principled design of robust and versatile MOT systems suitable for real-world deployment.