Search papers, labs, and topics across Lattice.
This paper introduces QPID, a novel clip acquisition method for query-propagation multi-object tracking (MOT) that focuses on association instability in propagated track states, addressing the limitations of traditional output-level temporal uncertainty criteria. By applying two-sided perturbations to internal track states, QPID effectively measures prediction differences, allowing for the identification of clips that exhibit high instability and thus require annotation. Experiments demonstrate that QPID outperforms existing active learning baselines while maintaining the same annotation budget, highlighting its effectiveness in optimizing dataset construction for MOT models.
QPID reveals that targeting association instability in track states can significantly enhance the efficiency of active learning in multi-object tracking.
Training query-propagation end-to-end multi-object tracking (MOT) models requires dense bounding-box and identity annotations across video sequences, making dataset construction expensive. Clip-level active learning reduces this cost by selecting video clips for annotation, but prior acquisition criteria based on output-level temporal uncertainty may miss clips whose informativeness comes from association instability in propagated track states. We propose QPID (Query-Propagation Instability and Diversity), a clip acquisition method for query-propagation MOT that targets association instability in propagated track states. QPID estimates this instability by applying two-sided perturbations to internal track states and measuring prediction differences from a clean reference branch. The key idea is that, in stable clips, each propagated track should continue to follow the same target under small perturbations, whereas in ambiguous clips, small changes in the track state can alter which target the track follows, leading to changes in localization or confidence. QPID measures these perturbation-induced prediction differences with two metrics: Localization Drift and Entropy-Weighted Confidence Discrepancy. These metrics are aggregated into a clip-level association-instability score. To avoid redundant uncertainty-only selection, QPID selects a representative annotation batch from high-instability clips using Uncertainty-Weighted Visual Coverage with track-level visual prototypes. Experiments on DanceTrack and SportsMOT with MeMOTR and SambaMOTR show that QPID achieves strong performance compared with active learning baselines under the same annotation budget.
