Search papers, labs, and topics across Lattice.
This paper investigates the temporal reasoning capabilities of single-stage video object detectors, addressing a critical gap in understanding whether these models utilize temporal context or rely on single frames for predictions. The authors introduce TemporalLens, a diagnostic framework that employs various perturbation techniques to evaluate temporal dependence, revealing that stacked 2D models fail when the target frame is removed, while spatiotemporal models leverage information from earlier frames. Additionally, they present YOLO-3D, a modular spatiotemporal detector that significantly improves performance by preserving temporal depth, achieving a +3.7 percentage point increase in mAP@50 across scales.
TemporalLens reveals that many video detectors are blind to temporal context, while YOLO-3D demonstrates that preserving temporal depth can dramatically enhance detection performance.
Single-stage video object detectors are increasingly deployed in time-critical applications, yet it remains unclear whether these models genuinely reason over temporal context or merely exploit a single informative frame-a gap hidden by standard metrics, which reward correct predictions regardless of how they are reached. We address this from two complementary directions: first, we propose TemporalLens, a model-agnostic diagnostic framework probing temporal dependence through controlled perturbations, structured occlusions, temporal shuffling, redundancy injection, and resolution degradation, revealing whether a detector actually uses information across time. Applied to stacked-frame 2D detectors and our YOLO-3D architecture, it exposes behavioural differences invisible to mAP: stacked 2D models collapse when the target frame is removed, while spatiotemporal models recover predictions from earlier frames, a signature of real temporal reliance. Second, we detail YOLO-3D, a modular real-time spatiotemporal detector built on YOLOv8, and show that simply preserving temporal depth through the backbone is the dominant performance driver (+3.7 pp mAP@50 at 32 frames averaged across scales). Together, the diagnostics and architecture turn "does this detector reason over time?" into a measurable, actionable question.
