Search papers, labs, and topics across Lattice.
This paper introduces Temporal Feature Distillation, a semi-supervised learning approach designed to enhance Precise Event Spotting (PES) in sports videos by aligning temporally informative features instead of relying solely on projection-head outputs. The method addresses the challenge of preserving critical motion cues that are often lost in traditional self-distillation techniques, leading to improved sensitivity to event boundaries. Experimental results demonstrate that under limited supervision, the proposed approach significantly outperforms existing methods, achieving a 4.54 point improvement in mean Average Precision (mAP) on the FSPerf dataset and matching fully supervised performance in other cases.
Temporal Feature Distillation boosts PES accuracy by over 4 points with less than 10% labeled data, outperforming traditional methods that struggle with subtle motion cues.
Precise Event Spotting (PES) requires distinguishing visually similar yet semantically distinct adjacent frames, making it fundamentally different from image classification and coarse action recognition. Although self-distillation methods such as DINO have shown strong representation learning ability in images, we find that directly applying them to PES is ineffective: without supervised guidance, subtle but crucial motion cues are often suppressed as noise, leading to representations that are insensitive to precise event boundaries. To address this, we propose Temporal Feature Distillation, a semi-supervised objective that aligns temporally informative backbone features, rather than projection-head outputs, to preserve motion-sensitive and boundary-aware cues for frame-level localization. A supervised warm-up with a ramp-up schedule further stabilizes training by ensuring that meaningful event cues are learned before unlabeled distillation begins. We also introduce Transformer Gate Shift, a multi-scale gated shifting module that injects motion-aware temporal information into Vision Transformers. Experiments on four fine-grained sports benchmarks show consistent improvements over fully supervised and semi-supervised baselines. Under 10\% supervision on FSPerf, our method improves mAP by 4.54 points over the strongest competing approach, and with only 80\% labeled data, it matches or surpasses the fully supervised 100\% baseline on two of the four datasets.
