Search papers, labs, and topics across Lattice.
To resolve temporal insensitivity and textual ambiguity in training-free video temporal grounding, DSE-VTG establishes a dual-enhancement framework that operates entirely at inference time without requiring dense annotations or task-specific training. The approach combines multi-scale frame- and clip-level similarity fusion with test-time optimization of a lightweight additive query offset, completely avoiding backbone fine-tuning or external LLM calls. Across multiple benchmarks, it improves Charades-STA mIoU by 5.61 points over prior training-free methods and beats the strongest fully supervised baseline by 2.76 mIoU under out-of-distribution distribution shift on Charades-CG.
Training-free video grounding can surpass supervised baselines under distribution shifts simply by pairing multi-scale similarity fusion with lightweight, test-time query adaptation.
Text-guided Video Temporal Grounding (VTG) aims to localize the relevant segments in an untrimmed video based on text queries, yet collecting dense temporal annotations and training task-specific models remain costly and brittle under distribution shift. Recent training-free VTG approaches mitigate this issue by directly matching pretrained vision-language representations, but they still face two fundamental information bottlenecks: frame-wise visual encoding overlooks temporal dynamics, while fixed query embeddings cannot resolve query ambiguity. To address these issues, we propose DSE-VTG, a \underline{D}ual-\underline{S}ide \underline{E}nhancement framework that addresses both without any task-specific training. On the visual side, Multi-scale Similarity Fusion (MSF) combines frame- and clip-level similarities into a unified, temporally aware similarity profile. On the textual side, Query-level Test-Time Adaptation (Q-TTA) optimizes a lightweight additive offset to adapt the query embedding to the video at test time, without finetuning the backbone or calling external large language models. Extensive experiments on three standard and two OOD benchmarks show that DSE-VTG achieves state-of-the-art performance among training-free methods. On Charades-STA, it improves mIoU over the strongest prior training-free method by 5.61 points. Under distribution shift, DSE-VTG reaches 50.86 mIoU on Charades-CG Novel-Word, surpassing the strongest supervised baseline by 2.76 mIoU. Our code will be released upon acceptance.