Search papers, labs, and topics across Lattice.
This paper introduces the Distribution-Alignment Bridge (DAB), a novel framework for text-to-video retrieval that treats the task as a distribution alignment problem rather than simple point matching. By representing text and video embeddings as Gaussian distributions with mean and variance, DAB effectively incorporates modality-specific uncertainties and refines text distributions towards target video distributions using a diffusion-inspired iterative process. The proposed method, validated on multiple benchmarks, demonstrates significant improvements over traditional probabilistic and diffusion-based approaches, achieving calibrated uncertainty-aware ranking through its unique distribution-aware contrastive loss.
Transforming text-to-video retrieval into a distribution alignment task leads to significant performance gains and better uncertainty calibration in ranking.
This paper proposes the Distribution-Alignment Bridge (DAB), a framework that reconceptualizes text-to-video retrieval as a distribution alignment task rather than traditional deterministic point matching. By modeling both text and video embeddings as Gaussian distributions defined by mean and variance, DAB explicitly accounts for modality-specific uncertainty. We employ a deterministic, diffusion-inspired bridge to iteratively refine text distributions toward their target video distributions through a truncated refinement process. This approach unifies probabilistic embedding and distributional transformation into a cohesive, end-to-end trainable system. To optimize cross-modal similarity, we introduce a distribution-aware contrastive loss based on Kullback-Leibler divergence. Extensive evaluations on MSR-VTT, MSVD, and VATEX benchmarks confirm that DAB significantly outperforms existing probabilistic and diffusion-based baselines, while providing calibrated uncertainty-aware ranking through bridge-induced distributional margins.
